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Prefac. 


The  purpose  of  this  effort  was  to  investigate  the  fea¬ 
sibility  of  a  moving  bank  multiple  model  adaptive  estimation 
algorithm.  Multiple  model  adaptive  estimation/control  appeals 
to  me  through  its  straightforward  method  of  parameter  adap¬ 
tation.  However,  practical  limitations  to  this  method  of 
adaptive  estimation/control  arise  when  there  are  a  large 
number  of  uncertain  parameters,  or  a  fine  parameter  space 
discretization.  The  modified  multiple  model  adaptive  esti¬ 
mation/control  method  explored  in  this  thesis  circumvents  the 
practical  limitations  of  the  conventional  approach,  without 
significantly  increasing  complexity. 

I  wish  to  express  my  gratitude  to  my  thesis  advisor,  Dr. 
P.  S.  Maybeck,  for  his  guidance,  encouragement,  and  enthusi¬ 


asm  throughout,  this  effort.  Thanks  are  also  due  Maj.  W.  H. 

I 

Worsley  for'  his  assistance.  Finally,  I  wisA  to  thank  my 
wife  Sand!  for  her  encouragement,  support,  and  understand¬ 
ing. 
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Abstract 

This  investigation  examines  the  feasibility  of  a  moving 
bank  multiple  model  adaptive  estimation/control  algorithm. 
Eliding  bank  multiple  model  adaptive  estimation  differs  from 
conventional  multiple  model  adaptive  estimation  in  that  a 
substantially  reduced  number  of  elemental  filters  is  required 
for  the  sliding  bank  estimator  (9  elemental  filters  vs.  100 
for  the  system  modeled  in  this  thesis).  The  positions  in 
parameter  space  that  the  reduced  number  of  elemental  filters 
occupy  are  dynamically  re-declared{  i.  e.,the  sliding  bank 
of  filters  is  moved  about  the  parameter  space  in  search  of 
the  true  parameter  point. 

Critical  to  the  performance  of  the  sliding  bank  estimator 
i3  the  decision  method  that  governs  movement  of  the  bank  of 
elemental  filters.  Because  of  this,  a  number  of  different 
decision  algorithms  are  discussed  and'tueir  respective  per¬ 
formance  compared.  Three  controller  do signs  are  also  exam¬ 
ined:  a  single  changeable-gain,  a  single  fixed-gain,  and  a 
sliding  bank  multiple  model  adaptive  controller. 

States  of  a  damped  second  order  system,  with  uncertain 
parameters  (damping  ratio  and  undamped  natural  frequency)  are 
estimated  by  the  sliding  bank  estimator  and  then  regulated 
to  the  quiescent  state  by  the  controller,  performance  of 
the  sliding  bank  estimator/controller  is  compared  to  a  bench- 
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mark  of  a  single  Kalman  filtur/LQ  controller  that  has  (ar¬ 
tificial)  knowledge  of  the  true  parameter  values.  Comparisons 
are  based  upon  Monte  Carlo  analysis  results. 

The  results  demonstrate  that  the  sliding  bank  multiple 
model  adaptive  estimator/controller  is  a  possible  alternative 
to  the  conventional  full  bank  multiple  model  adaptive  esti¬ 
mator/controller.  For  the  system  modeled  in  this  study, 
performance  of  the  sliding  bank  estimator/controller  is  es¬ 
sentially  identical  to  that  of  the  benchmark  after  a  short 
parameter  acquisition  period. 


FEASIBILITY  ANALYSIS  OF  MOVING  BANK  MULTIPLE 

MODEL  ADAPTIVE  ESTIMATION  AND  CONTROL  ALGORITHMS 

I.  Introduction 

1.1.  Background 

In  many  estimation  and  control  problems,  uncertainties 
exist  in  the  system  model  and  .in  parameters  defining  the 
properties  of  driving  noises  and  measurement  noises.  The 
performance  of  the  Kalman  filter  is  suboptimal  when  the  infor¬ 
mation  describing  the  system  and  required  to  construct  the 
filter  is  only,  approximately  known.  This  gives  rise  to  the  ' 
need  for  adaptive  estimation/control.  There  are  many  approaches 
to  adaptive  estimation/control,  and  a  comprehensive  classi¬ 
fication  of  the  various  techniques  and  an  extensive  bibliog¬ 
raphy  is  presented  by  Asher  et  al  (1). 

In  a  large  class  of  problems,  the  system  can  be  mo¬ 
deled  as  a  linear  system  with  uncertain  parameters  affecting 
the  system,  driving  noises,  and/or  measurement  noises. 

Using  this  model,  one  approach  to  adaptive  estimation  is 
to  form  a  bank  of  Kalman  filters,  one  filter  for  each  pos¬ 
sible  value  of  the  uncertain  parameter  vector.  The  output 
of  each  filter  is  then  weighted  by  the  a  posteriori  proba¬ 
bility  of  that  particular  parameter  being  correct,  condi¬ 
tioned  on  the  observed  history  of  measurements.  The  weighted 

*  Referred  to  as  3ayesian,  Fartitioned,  or  Multiple 
Model  Adaptive  Estimation. 
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outputs  are  then  summed  to  form  an  optimal  estimate  of  the 
system  state. 

This  approach  was  first  presented  by  Magill  (2)  for 
the  case  of  perfect  scalar  observations  of  a  stochastic 
process  modeled  as  the  output  of  a  linear  dynamic  system, 
with  a  parameter  vector  modeled  as  unknown  but  selected 
from  a  finite  set  of  known  vectors,  driven  by  white  Gaus¬ 
sian  noise.  The  results  of  Magill  have  been  extended  by 
Hilborn  and  Lainiotis  (3)  to  vector  processes.  Lainiotis 
and  his  associates  (4,*>)  have  also  discussed  both  contin¬ 
uous  and  discrete  time  adaptive  estimation  schemes  based 
on  the  Bayesian  approach  with  either  continuous  or  dis¬ 
crete  parameters. 

1.1.1.  Bayesian  Estimation  Algorithm  Development. 
(6:129-136)  Let  the  system  under  consideration  be  described 
by  the  following: 

£(1W  *  *  Ws/V 

z(ti)  »  HCt-^x^)  ♦ 

where,  letting  the  underscored —denote  random,  process: - 


state  vector 

state  transition  matrix 

u(ti): 

known  input  vector 

W! 

input  matrix 

Sd<V! 

white  Gaussian  input  noise  vector 

noise  input  matrix 

measurement  vector 

measurement  matrix 

v(t): 

white  Gaussian  measurement  noise  vector 
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and  the  following  statistics  apply: 

E{Wd(ti)!*0 

E|^d(ti)wT(t.)}  = 

2{v(t .)(  -  0 
Elv(ti)vT(ti)|  * 

wh^re  is  the  Kroneker  delta  function.  It  is  also  assumed 
ij 

that  x(tQ),  w^Ct^),  and  v(ti)  are  independent  for  all  t^. 

Now,  let  a  be  the  uncertain  constant  parameter  vector 
which  is  an  element  of  A,  where  A  is  a  subset  of  Rp.  The 
parameter  vector  a  can  affect  any  or  all  of  the  following: 

<J>,  B^,  Qd,  H,  and  R.  The  Bayesian  estimator  computes  the 

following  conditional  probability  density  function: 

'*a|Z(tf)(aUi>  (I-1) 

where  Z(t^)  is  a  vector  of  measurements  fronr  tQ  to  t^, 

The  second  term  on  the  right  side  of  equation  (1-1) 
can  be  further  evaluated: 

fa|Z(ti)(2.!ii)  •  fa|z(ti),Z(ti^1’)(iUi»^i-1) 


(1-2) 


Conceptually,  equation  (1-2)  can  now  be  solved  recur¬ 
sively,  starting  from  an  a  priori  probability  density  of 

fa(a),  as  fg(t  )| a,Z(t.  ) ^i\  *’h-1 )  is  Gaussian  with  a 

mean  of  H(ti)'x(ti"j  and  covariance  [H(t^)P(ti“)H'I,(ti)  +  R(ti)] 

where  ^(ti*r)  and  P(t.j~)  are  the  conditional  mean  and  cova¬ 
riance  respectively  of  x(t.)  just  prior  to  the  measurement  at 

S3  X 

t. ,  assuming  a  particular  realization  a  of  a. 

-*“  •  S3 


Using  the  conditional  mean,  the  estimate  of  x(t. ) 

S3  X 

becomes: 

SlxCVIZCV  -  Zt\  )|2(t  )(£|2i)ta 

—  oo  85  1  1  ~  1 


dx  (1-3) 


[  /f  x(  ti),||2(t.)(^^|2i  )da]: 

03 

*  7^[-(*fx(ti)|a,Z(ti)^l^»ii);fajZ(ti)^l-i5^ 

oo 


where  the  term  in  brackets  is  the  estimate  of  x(t, )  based  on 

a  particular  value  of  the  parameter  vector.  This  would  be 
the  output  of  the  Kalman  filter  based  on  a  particular ' para- 

4  '  •  : 
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meter  value.  When  a  is  continuous  over  A,  this  would  re- 
quire  an  infinite  number  of  filters  in  the  bank.  In  the 
continuously  distributed  parameter  case,  what  is  typically 
done  is  to  discretize  the  parameter  space,  yielding  a  finite 
number  of  filters.  The  integrals  over  A  in  equations  (1-3) 
and  (1-4)  then  become  summations;  letting  Pjc(ti)  be  defined 
as  the  probability  of  the  kth  elemental  filter  being  correct 
conditioned  on  the  measurement  history: 

fz( t.)|a,Z(t.  J^ilSk’^i-l^k^i-1^ 

7- . . -  -  (1-5) 

*  E{x(t±)|  Z(ti)  =  Zj 
K  . 

*  E^C^i  )pk(ti)  (1-6) 

k=1  *  x  *■  x 

where  a  C  [a^  ,a2 , . . .  ta^]  and  ^(t^)  is  the  mean  of  x^) 
conditioned  on  a  »  a^  and  Z(ti)  a  ZL,  i.e.  the  output  of  the 
k  Kalman  filter  in  the  bank.  Pictorally  the  algorithm 
appears  as  in  Figure  1-1 . 

The  probability  weighting  factors  for  each  Kalman 
filter  are  calculated  from  equation  (1-5),  where 

fz(ti)|a,Z(t.  )(ii|Sk»ii.i)  * 


(2') 


E7? 


w 


n  (1-7) 


and 


V^l)  "  ♦  MV 

MV  -  Si  -  Hl&CO 
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Figure  1-1 .  Multiple  Model  Filtering  Algorithm 

#• 


Both  the  residual  covariance  A^C^)  and  the  residual  r^t^ 
itself  are  readily  available  from  the  elemental  filter. ' 
the  estimate  of  the  parameter  and  the  covariance  of  the  para¬ 
meter  are  given  by: 

CO 

4  ElglZO^)  .  ZjJ  v/afa|Z(t.)(2|Zi)Sa 

—03  s;*s!  1 

*  /S  £  *(a  -  ak)]da 

.08  '*^*1 

K 

*  jE^Pk^i5  (1-3) 

and 
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E{[|  -  t(ti)]  [a  -  -  h}  * 

~  — [fe  ”  '®(t1)JTph.C'ti>  (1-9) 


The  covariance  of  the  state  estimate  is  given  hy: 


E{[*^ti^  ”  ^(ti+)]  [x(-ti)  -  §(‘ti+)]T  ZC^)  *  Zjj 


=/  [i  -  -  t(1;i+)]Tfx(ti)|z(ti)^lli>S2 

*  kt  pk(t1){/[i  -£<*/)][*.-  %h*)]f 

1.1.2.  Convergence .  The  above  estimation  algorithm' 
is  optimal  under  the  conditions  that  the  parameter  space 
is  in  fact  finite,  discrete,  and  the  parameter  vector  re¬ 
mains  at  a  constant  unknown  value.  The  algorithm  will  con¬ 
verge  to  the  true  parameter  value,  i.e. 

lim  plc(ti)  »  0  for  a  +  a^ 

lim  pk(tt)  *  1  for  a  » 

as  has  been  shown  by  Hawke  s  and  Moore  (7).  When  the  under¬ 
lying  parameter  space  is  in  fact  continuous  and  the  true 
parameter  lies  somewhere  between  the  discretized  parameters, 
the  algorithm  does  not,  as  one  might  expect,  converge  to  the 
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condition  of  nonzero  probability  associated  with,  the  several 
discretized  values  that  are  close  to  the  true  value,  but 
instead  it  converges  to  the  single  discrete  parameter  that 
is  "nearest”,  as  defined  in  (7),  to  the  true  parameter. 

The  above  results  have  been  extended  to  the  case  of 
unknown  biases  in  the  measurement  process,  (E{v(t,  )f  =*  m  (t. ), 

where  m^t^)  can  be  affected  by  the  parameter  vector)  by 

Dasgupta  and  Westphal  (8).  Under  these  conditions,  the 
filter  may  converge  to  a  parameter  value  that  is  not  close 
to  the  true  value,  and  erroneous  estimates  may  result. 

One  should  note  that  the  performance  of  the  filter  is 
dependent  on  the  difference  between  the  residuals  of  the 
"correct"  elemental  filter  and  the  residuals  Of  the  mismatched 
filters.  Should  the  residuals  be  consistently  of  the  same 
size,  equation  (1-7)  indicates  that  the  filter  with  the 
smallest  value  of  |AjJ  would  eventually  be  identified  as 
the  correct  filter.  Since  |AkJ  is  independent  of  both  the 
residuals  and  the  elemental  filter's  correctness,  erroneous 
system  identification  could  result.  It  is  therefore  important 
that  pseudonoiae  added  during  filter  tuning  to  mask  model  in¬ 
adequacies  not  be  so  strong  as  to  mask  the  correctness/incor- 
rectnesa  of  the  elemental  filters,  thus  allowing  the  adaptive 
filter  to  converge  to  an  erroneous  parameter  value. 

To  date,:  satisfactory  theoretical  convergence  results 
are  not  available  fcr  more  general  conditions,  as,  for  example 
varying  parameters(8) .  When  the  parameters  are  slowly  varying 


the  filter  may  converge  to  a  particular  parameter  value  be¬ 
fore  the  true  parameter  varies  significantly  and  remain  at 
that  value  from  then  on,  while  the  true  parameter  may  eventu¬ 
ally  become  significantly  different  from  the  -estimated  value. 

1.1.3.  Varying  Parameters.  Under  the  conditions  of 
varying  parameters,  several  modifications  have  been  made  to 
the  multiple  model  adaptive  estimation  algorithm.  If  the 
parameters  are  slowly  varying,  an  ad  hoc  approach  has  been 
to  lower  bound  the  p,,(t.  )'s  to  prevent  them  from  converging 
to  zero  (6:135). 

Another  approach  is  to  model  the  possible  parameter 
variations;  however,  the  optimal  state  estimate  would  then 
be  the  weighted  sum  of  estimates  produced  by. filters  matched 
to  all  possible  parameter  histories.  This  would  require  K3- 
elemental  estimators  at  time  t.^,  clearly  an  impractical  approach. 
If,  however,  the  parameter  variation  is  a  Markov  process,  it 
has  been  shown  that  the  number  of  elemental  estimators  would 
remain  at  K  (6:136).  3ven  this  may  be  impractical,  however; 

■for  the  case  of  two  uncertain  parameters,  each  discretized  to 
10  values,  K  *  100  while.  »  10,000. 

1.1.4.  Control.  There  are  several  "assumed  certainty 
equivalence  design"  (9:241)  approaches  to  controlling  systems  . 
with  uncertain  parameters.  One  approach  is  to  use  a  multiple 
model  adaptive  estimator  to  generate  an  accurate  state  esti¬ 
mate  and  then  input  the  estimate  to  a  fixed  gain  controller 
robustified  about  some  nominal  value  of  the  parameter  vector, 


-nom*  The  *orm  of  the  algorithm  is' 

u(t. )  =  -G  ft.  »a  *|x(t.  +  ) 

.  — '  i'  c J_  nomj— v  1 

or  the  steady-state  eons  Lurit-gairi  version 

uCt^  -  -ac[anoB1]£( tt"> 

Another  approach  is  to  use  the  multiple  model  adaptive 
estimator  to  generate  both  a  state  estimate  and  an  estimate 
of  the  parameter  (Equation  1-8).  The  parameter  estimate 
can  then  be  used  to  change  the  gain  of  the  controller  as, 

u(ti)  *  -G*  [t i ,a( ti“ )] x( t^+ ) 
or  the  steady-state  constant-gain  version 


u(ti).=  -G*[a(t*)]x(ti+) 


where  a(t^"*)  is  used  instead  of  a(  t^* )  to  reduce  computational 
delay. 

A  third  approach,  referred  to  as  mu] tiplc-  model  adap¬ 
tive  control,  (9:^53),  is  to  form,  K  elemental  controllers,  ■ 
each  fed  by  the  output  of  one  of  the  K  elemental  estimators. 
The  controllers  are  matched  to  a  particular  parameter  value 
in  the  same  fashion  as  the  elemental  estimators.  The  out¬ 
puts  of  the  elemental  controllers  are  then  put  through  the 
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same  weighted  average  as  were  the  elemental  estimators; 

H-k < i >  ■ 

H(ti>  - 

1.1.5.  Applications.  The  multiple  model  approach  to 
adaptive  estimation/control  has  been  successfully  applied 
to  a  number  of  practical  problems.  It  has  shown  promising 
results  in  the  area  of  maneuvering  target  tracking  (10,  11, 

12,  13,  14).  It  also  has  been  used  in  flight  control  (15), 
adaptive  deconvolution  of  seismic  signals  (16),  multiple 
hypothesis  testing  (17),  and  detection  of  incidents  on  free¬ 
ways  (18).  In  addition,  multiple  model  adaptive  estimation 
has  demonstrated  promising  results  in  situations  where  large 
initial  uncertainties  exist,  as  in  terrain  aided  navigation 
(19,  20)  where  non-adaptive  extended  Kalman  filtering  tech¬ 
niques  can  lead  to  filter  divergence. 

1.2.  Problem 

The  major  drawback  to  the  multipit:  model  adaptive  esti¬ 
mation  approach  is  the  number  of  filters  needed  for  imple¬ 
mentation.  Consider  a  simple  case  of  a,  two  element  para¬ 
meter  vector,  with  each  element  taking  on  10  possible  values, 
as  mentioned  previously.  The  number  of  elemental  Ka j man 
filters  needed  for  the  algorithm  is  then  10"  =  100.  This 
clearly  presents  a  computational  burden. 

•  1 1 


Several  approaches  have  been  suggested  to  alleviate  the 
computational  demands  of  the  algorithm.  Lamb  and  Westphal 
(21)  presented  a  method  in  which  the  adaptive  filter  is 
initialized  with  a  coarse  discretization  of  the  parameter 
space.  After  the  filter  converges  to  the  "nearest"  parameter, 
the  parameter  space  is  rediscretized  using  a  simplex-directed 
method.  The  discretization  becomes  finer  and  finer  in  a  con¬ 
tracted  parameter  space  about  the  true  parameter  value.  An¬ 
other  approach  is  to  structure  the  algorithms  hierarchically 
to  reduce  the  number  of  elemental  filters  (22).  "Pruning" 
or  "merging",  branches  of  "decision  trees"  are  also  approaches 
aimed  at  reducing  the  computational  burden  (23,  24). 

The  approach  presented  in  this  thesis  is  to  form  a 
"sliding  bank"  of  elemental  estimators.  By  only  implementing, 
for  example,  the  nine  filters  corresponding  to  the  parameter 
values  t'jit  most  closely  surround  the  current  best  estimate 
of  the  parameter,  a  significant  reduction  in  the  number  of 
elemental  filters  is  achieved.  The  method  dynamically  re¬ 
declares  what  parameter  values  are  assumed  by  each  filter 
in  the  bank. ' 

The  purpose  of  this  effort,  is  to  evaluate,  the  perfor¬ 
mance  potential  of  a  sliding  bank  multiple  model  adaptive 
estimator/controller . . 

1.3.  Scope 

A  sliding  bank  adaptive  estimator  is  evaluated  for  a 
simple,  but  physically  motivated,  application.  A  damped 
second-order,  single  input,  single  output  system  model  is 


■used,  with  tv/ o  uncertain  parameters  (damping  ratio  £  and 
undamped  natural  frequency  <u).  The  input  and  measurement 
noise  characteristics  are  assumed  known  with  no  uncertainty 
and  modeled  as  independent  white  Gaussian  processes  with 
strengths  Q  and  R  respectively.  The  parameters  are  discre¬ 
tized'  into  10  values  each. 

1.4.  .Approach 

The  performance  of  the  sliding  bank  multiple  model 
adaptive  estimator/controller,  its  ability  to  estimate  both 
states  and  parameters  as  well  as  to  apply  adequate  control  to 
the  true  system,  is  compared  to  a  benchmark  of  a  single 
Kalman  filter/controller  based  on  (artificial)  perfect  know¬ 
ledge  of  the  true  parameter  value.  Estimator  performance  is 
evaluated  under  the  following  conditions: 

a.  the, true  parameter  value  i3  constant  and  exactly 
equal  to  one  of  the  discretized  parameter  values 

b.  the  true  parameter  value  is  constant  and  lies  in 
a  continuous  range  between  the  discrete  values  ■ 

c.  the  true  parameter  is  constant  and  lies  outside 
the  initial  conditions  chosen  for  the  bank  (but 
within  the  overall  parameter  space) 

d.  the  true  parameter  value  is  slowly  valuing  within 

the  overall  parameter  space  , 

e.  the  true  parameter  value  undergoes  jumps  in  value 

Additionally,  the  relative'  performance  and  computa¬ 
tional  burden  are  evaluated  for  the  following  controller 
design  strategies: 

a.  the  sliding  bank  estimator  is  used  to  generate  a 
good  state  estimate  which  is  passed  to  a  single 
fixed-gain  controller 
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b.  the  parameter  estimate  is  used  to  change  a  single 
controller  gain  that  is  used  to  premultiply  the 

'  "good"  state  estimate  provided  by  the  sliding  bank 
estimator 

c.  a  separate  controller  is  tied  to  each  estimator 
and  th;  controller  outputs  are  then  put  through 
the  weighted  average 

The  sliding  bank  algorithm  structures  investigated  are: 

a.  acquisition  vs.  track  discretizations. 

b.  means  of  determining  parameter  values  associated 
with  the  filters  in  the  sliding  bank  (different 
algorithms) 

c.  constant  gain  filters  and  controllers 
1.5.  Organization 

The  remaining  sections  of  this  thesis  are'  organized  as 
follows.  Chapter  II  develops  the  sliding  bank  estimator. 
Chapter  III  discusses  the  controller  structures.  Chapter  IV 
presents  the  simulation  used  to  evaluate  the  sliding  bank 
.estimator/controller  performance.  Chapter  V  is  an  analysis  of 
the  results  of  the  simulation.  Chapter  VI  contains  the  con¬ 
clusions. 


II.  Estimator 


II. 1.  Introduction 

A  second  order  system  with  uncertain  damping  ratio, 
f,  and  undamped  natural  frequency, «,  is  to  he  regulated. 
Although  a  simple  system,  this  is  physically  motivated;  for 
example,  in  the  design  of  controllers  for  flexible  vehicles, 
the  parameters  describing  bending  modes  are  often  subject 
to  considerable  uncertainty.  Figure  II— 1  is  a  block  diagram 
of  the  overall  system.  This  chapter  details  the  true  system 
and  the  sliding  bank  estimator. 


w(t) 


V' 


c<t) 


w(t):  driving  noise 
X(t^):  measurement  noise 


Figure  II-1.  Overall  System 
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mean,  white  Gaussian  noise  w(t)  with  a  constant  strength  Q, 
in  addition  to  the  control  input  u(t).  Equation  ( II— 2 )  now 
becomes 


x  a  Px  +  Bu  +  Gw 

<-s* 


(II— 3 ) 


£,(*) 

x2(t) 


0  1  x  (t) 

2  +' 

— Ct>  x,(t)  w 


+  2  H(t) 


0 

.2  sw 


with 


E{w(t)w(t+r)|  =.  QS(  r) 


The  filter  will  be  using  sampled-data  measurements  ■ 
and  the  controller  will  be  applying , sampled-data  control  to 
enable  implementation  of  the- filter/controller  on  a  digital 
computer.  We  are  therefore  motivated  to  form  an  equivalent 
discrete-time  model  of  the  true  system  for  propagating  esti¬ 
mates  from  one  sample  time  to  the  .next.  The  equivalent  dis¬ 
crete-time  model  of  equation  (lI-3)  is 


x(t1+,)  ♦  Bdu(tt)  *  S^V 


(II-4) 


$  *  *\)  the  state  transition  matrix  from  t^  to 

t. .  ' 


where 


ti 

EiGd&(ti)Sd(ti)Gd  }  -  ri+1<Mt-  +  ,  ,  r  )GQGW(ti+1  ,r)dr 
^  "t  • 


The  uncertain  and/or  varying  parameters  are  £  and  <u. 
The  parameters  will  affect  the  <fc,  Bd»  and  Gd  matrices,  as¬ 


suming  that 


*  Isio 


°dGd  ”/ti+1^ti+1  ’  ')OQgV(  t1+1  ,  r)d» 


It  is  assumed  that  the  damping  ratio,£,  can  assume  values 
between  0  and  1  and  the  undamped  natural  frequency ,  can 
assume  values  between  2*  radians/sec  and  20»  radians/sec 
(1Hz  <  f  <  10Hz). 

Measurement  of  the  state  vector  is  available  in'  the  form 


*'(ti)  *  Hx(ti)  +  v(ti) 


g(ti)  =*  [1  0]  X1(ti)  ♦  V^) 

MV 


(II-5) 


where  v(t.)  is  a  zero-mean  discrete  white  Gaussian  noise 

'  2,  * 

with  constant  variance  R.  In  other  words,  noise  corrupted 
measurements  of  the  position- type  state  variable  are  avail¬ 
able  for  the  estimator. 

II. 3.  Sliding  Bank 

The  parameters  C  and  <u  are  each  discretized  into  10 
values,  forming  a  10  by  10  grid  within  the  two  dimensional 
parameter  space.  The  full-bank  multiple  model  adaptive 
estimator  is  composed  of  ICO  filters,  one  for  each  point  in 
the  parameter  space.  The  sliding  bank  estimator  on  the  other 
hand,  is  composed  of  a  subset  of  the  full  bank.  Only  9 
filters  are  implemented,  corresponding  to  9  points  in  the 
parameter  space,  and  the  specification  of  which  particular 
9  points  is  dynamically  changeable. 

11. 3.1.  Parameter  Space .  The  damping  ratio, £,  is 
discretized  linearly  between  0  and  1.  Since  the  frequency, 
response  characteristics  of  the  trues  system  vary  logarithm¬ 
ically,  the  undamped  natural  frequency ,a>*  is  discretized 
logarithmically  between  2n  and  20 n  jrad/sec.  Table  IX— 1 
summarizes  the  discretizations. 

11. 3.2.  Elemental  Estimator.  The  elemental  estima- 
■  tors  are  each  constant  gain  Kalman  filters,  the  gains  de¬ 
pendent  upon  which  point  in  the  parameter  space  is  associated 
with  that  particular  filter. 

.4.1* 

The  k  elemental  filter  estimate  of  x(t),  denoted 
by  ^lc(t),  is  propagated  from  just  after  the  last  measurement 
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TAEL2  II-1 


Parameter  Discretizations 


< 

«t»  (rad/sec) 

0 

6.23. 

.1111 

8.12 

.2222 

10.48 

.3333 

13.54 

.4444 

17.48' 

.5556 

22.58 

.6667 

29.16 

.7773 

37.67 

.8889 

48.65 

1 

62.83 

to  just  before  the  next  measurement  by 

Sc(ti  ^  *•  ^k-k^i-l V'+  ^dj^i-l^.  (II-6) 

it 

and  is  updated  by 

*  $c<V>  ♦  Kk[*<V  •  .  01-7) 

where 

^  is  the  state  transition  matrix  from  ti_1 

to  t^ ,  based  on  the  k^*1  point  in  the  para¬ 
meter  space 
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is  the  input  matrix  based  on  the  k-th  point 
Qk  in  the  parameter  space 

is  the  steady  state  Kalman  filter  gain  asso¬ 
ciated  with  the  k-th  point  in  the  parameter 
space 

z(ti)  is  the  measurement  at  time  t^ 

H  is  the  constant  measurement  matrix 

1 1. 3. 3.  Weighted  Average.  The  outputs  of  each  ele¬ 
mental  filter,  are  put  through  a  weighted  average, 

in  the  same  manner  as  in  Section  1.1.1,  to  produce  an  over¬ 
all  adaptive  estimate  of  x(t).  The  only  difference  is  that 
9  filters,  representing  a  subset  of  the  parameter  space,  are 
averaged  instead  of  a  full  set  of  filters,  representing  the 
entire  parameter  space; 

K—  1 


The  probability  weightings,  Pk(ti)'s,  are  calculated 
recursively  from  equation  (1-5),  equivalently 


W 


(11-9) 


where 


fK[z(ti)]  * 


>]2"(\2  +  R) 


exp 


-[*<V 


H'u  *  .0 
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and 


is  the  steady  state  filter  computed  var- 
iance  cf  x.  (t.“)  associated  with  the  kw 

1  _ 

parameter  point,  i.  e.  (t. ”)  in  steady 

*11  x 

state 


is  the  measurement  noise  strength 


II. 4.  Moving  the  Bank 

When  the  true  parameter  point  lies  within  the  space 
spanned  by  the  sliding  bank,  the  sliding  bank  estimator  be¬ 
haves  much  as  a  standard  full-bank  multiple  model  adaptive 
estimator.  It  is  the  condition  of  the  true  parameter  point 
residing  outside  the  space  spanned  by  the  sliding  bank  that 
musrt  be  accommodated.  This  condition  first  must  be  detected, 
and  then  appropriate  action  must  be  taken,  i.  e.  move  the 
bank  or  expand  the  bank  in  some  fashion.  Additionally, 
should  the  true  parameter  point  lie  near  the  perimeter  of 
the  space  spanned  by  the  bank,  a  move  to  center  the  bank 
over  the  true ' parameter  point  may  be  desired.' 

II. 4.1.  Detection.  A  number  of  methods  to  determine 
whether  or  not  the  true  parameter  point  lies  within  the. 
space  spanned  by  the  sliding  bank  are  proposed. 

.  II. 4. 1.1.  Residual  Monitoring.  When  the  true 
parameter  point  is  within  the  space  spanned  by  the  sliding 
bank,  all  of  the  likelihood  quotients,  defined  as  ■  . 


(11-10) 
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where 


rk  =  2  -  Hxk  =  z 

should  le  below  some  threshold  level,  where  the  threshold  level 
is  selected  in  an  ad  hoc  manner.  When  the  true  parameter  point 
is  outside  the  space  spanned  by  the  sliding  bank,  the  Lk' s 
should  all  be  above  this  threshold.  Therefore,  a  possible 
detection  scheme  would  be  to  move  the  bank  when 

min( L.|  ,  $  •  •  •  1 1*^ )  —  T 

where  T  is  the  chosen  threshold  value.  Additionally,  the  ele¬ 
mental  filter  nearest  the  true  parameter  point  should  have 
the  smallest  likelihood  quotient,  thereby  giving  an  indication 
of  the  direction  to  move  the  bank. 

II . 4 . 1 .  2 .  Parameter  Position  Estimate  Moni¬ 
toring.  Another  means  of  keeping  the  true'  parameter  point  in¬ 
side  the  space  spanned  by1 the  bank  is  to  keep  the  bank  centered 
on  the  current  estimate  of  the  parameter,  obtained  from  Equa¬ 
tion  (1-8).  (Note  that  the  bank  cannot  always  be  centered 
over  the  estimated  parameter  position,  as  when  the  estimated 
parameter  position  is  near  the  outer  edges  of  the  overall 
parameter  space,  centering  the  bank  would  require  that  some 
elemental  filters  lie  outside  the  overall  parameter  space.) 

If  the  distance  from  the  parameter  point  associated  with  the 
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center  of  the  hank  to  the  estimated  parameter  position  be¬ 
comes  larger  than  some  chosen  threshold,  a  move  of  the  bank 
is  indicated. 


II. 4. 1.3.  Parameter  Position  and  Velocity 
Estimate  Monitoring.  V/hen  the  true  parameters  are  slowly 
changing,  several  past  values  of  the  estimated  parameter  posi¬ 
tion  can  be  used  to  compute  a  parameter  velocity  estimate. 

The  parameter  velocity  estimate,  along  with  the  current  estimate 
of  parameter  position,  can  then  be  used  to  compute  a  projected 
parameter  position,  one  sample  period  into  the  future,  v/hen 
the  magnitude  of  the  distance  between  the  bank  center  and  the 
projected  parameter  position  exceeds  some  selected  threshold 
level,  the  bank  can  be  moved  in  anticipation  of  the  true 
parameter  point  movement. 


II. 4. 1.4.  Probability  Monitoring.  The 
probability  weightings,  p^t^’s,  are  another  indication  of 
elemental  filter  correctness.  If  any  of  the  probability 


weightings 
can  then  be 


i 


ise  above  a  chosen  threshold  level,  the  bank 
moved'  in  the  direction  of  the  filter  with  the 
highest  weighting.  Should  the  highest  weighting  be  on  the  ele¬ 
mental  filter  corresponding  to  the  center  of  the  bank,  the  bank 
i3  not  movec..  In  this  scheme,-  the  bank  seeks  to  center  it¬ 
self  on  the  elemental  filter  with  the  highest  probability 
weighting 

I 

II. 4. 1.5.  Parameter  Covariance  Monitoring. 
Another  potential  variable  in  design  is, the  size  of  the  bank. 


24 


Instead  of  the  elemental  filters  occupying  adjacent  points 
xn  the  parameter  space,  the  elemental  filters  could  be 
spaced  farther  apart,  thus  covering  a  larger  area  of  the 
parameter  space  with  a  coarser  discretization.  See  Figure 
II-2.  This  coarse  discretization  would  be  useful  in  an  ac 
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Figure  II-2.  Eank  Discretizations  a.  fine  discretization 
b.  coarse  discretization 
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quisition  cycle.  When  th<  sliding  bank  estimator  is  first 
turned  on,  the  discretization  could  be  set  so  that  the  slid¬ 
ing  bank  spans  the  entire  parameter  space.  The  parameter  co- 
variance  is  then  monitored  (Equation  1-9)  to  indicate 
when  the  bank  should  be  contracted.  When  the  covariance 
drops  below  some  selected  threshold,  the  bank  is  contracted 
about  the  estimated  parameter  position. 

Expanding  the  bank  can  also  be  performed  during  normal 
operation.  Should  the  true  parameter  undergo  a  jump  in 
position  or  vary  in  such  a  manner  that  the  sliding  bank 
"looses  track"  of  the-  true  parameter  position,  the  bank  can 
be  expanded.  An  indication  to  expand  the  bank  can  be  given 
by  residual  monitoring.  Again,  the  bank  is  contracted  when 
the  parameter  Covariance  drops  below  some  selected  threshold 
level. 

II. 4. 1.6.  Combinations .  Several  of  the 
above  detection  schemes  can  be  used  in  conjunction  with 
one  another.  For  example,  parameter  co-variance  monitoring 
and  residual  monitoring  can  be  used  together*  as  discussed 
in  Section  II. 4. 1.4.  Another  example  is  residual  monitoring 
and  parameter  position  estimate  monitoring  either  "anded"  or 
"or-ed"  together. 

II. 4. 2.  Appropriate  Action.  Two  courses  of  action  are 
available  when  it  is  detected  that  the  true  parameter  position 
is  outside  the  region  of  the  sliding  bank.  The  bank  can 
either  be  moved  in  the  direction  of  the  true  parameter  point 


so  as  to  encompass  it,  or  it  can  be  expanded  to  encompass  it. 

Figure  II-3a  depicts  a  move  and  Figure.  TT-3b  depicts  expansion. 

Uhen  the  bank  is  moved  or  expanded,  the  matrices  <t>^,  Bd  ,  and 

k 

Kk  of  each  elemental  filter  are  changed  to  correspond  to  the 
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'igure  11-3.  hank  :hangen  a.  bank  move  b.  bank  expansion 


new  parameter  points.  If  there  is  clear  evidence  of  which 
direction  points  toward  the  true  parameter,  it  is  more  approp¬ 
riate  to  move  the  bank.  If,  on  the  other  hand,  all  of  the  ,Lk's 
are  large  and  close  to  one  another  in  magnitude,  for  example, 
no  clear  indication  of  the  true  parameter’s  position  is  given 
and  it  is  more  appropriate  to  expand  the  bank. 

When  the  filter  is  either  moved  or  expanded,  any  changed 
elemental  filters  must  be  initialized  with  values  for  xk(t^) 
and  Consider  a  move  depicted  in  Figure  II-4.  Ele¬ 

mental  filters  1,  2,  4,  and  5  of  the  bank  after  the  move,  are 
the  same  as  elemental  filters  5,  6,  8,  and  9,  respectively, 


before'  the  move  and  therefore  do  not  need  to  be  changed  to 
new  values  of  <£k,  Bd  ,  Kk,  £k(ti),  and  Pk(tj,)*  Elemental 
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filters  3»  6,  7i  8,  and  9  after  the  move,  on  the  other  hand, 
are  changed  filters,  i.  e.  they  occupy  new  positions  in  the 
parameter  space,  not  covered  by  the  bunk  before  the  move.  The 
unchanged  elemental  filters  (1,  2,  4,  and  5  after  the  move) 
keep  their  current  values  of  x^(t^)  and  Pj^t^).  The  changed 
elemental  filters  (3,  6,  7,  8,  and  9  after  the  move)  are  the 
ones  that  must  be  re-initialized. 

One  appropriate  value  for  the  *k^i^'s  is  current 
sliding  bank  estimate  of  the  system  state,  x(ti'1').  Several 
options  exist  for  the  p^Ct^j's.  One  option  is  to  set  all  of 
the  Pk(ti)'s  (both  changed  and  unchanged  elemental  filters) 
to  1/9,  which  may  result  in  sluggish  convergence  to  a  parameter 
estimate.  Another  choice  is  to  reset  on^y  the  changed  elemental 
filters'  P^t^'s  to  some  value  indicating  the  changed  filters' 
correctness,  such  as 
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(note:  ch  *  changed,  unch  *  unchanged) 
where  s  is  a  scaling  factor  defined  by 
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so  that  the  sum  of  the  probabilities  remains  one  after  the 
reset: 

9 

E  =  1 

k=1  K  1 

Before  a  move  or  expansion  it  may  be  desirable  to 
‘•warm  up"  the  changed  filters  before  bringing  them  on  line , 
allowing  initial  transients  in  state  estimates  x.  (t. )  and 
conditional  probabilities  pk(t^)  die  out.  With  filter 
warm-up,  two  thresholds  will  be  used;  the  “move"  threshold 
will  be  the  same  but  an  additional,  tighter  "warm  up"  thres¬ 
hold  will  indicate  whether  or  not  to  warm  up  any  filters.  In 
Figure  II-5a,  an  additional  5  filters  are  initialized  as  above 
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Figure  I±-5.  Filter  Warm-up  a.  before  move  b.  after  move 
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when  the  "warm  up"  threshold  is  exceeded.  The  original  9 
filters  of  the  sliding  bank  continue  to  provide  the  overall 
estimate  while  the  5  additional  filters  are  warming  up.  Once 
the  move  threshold  is  exceeded,  the  5  warm-up  filters  are 
brought  on  line  and  the  5  filters  of  the  bank  before  the  move 
are  taken  off  line,  thus  accomplishing  a  move. 

II. 5.  Summary 

The  true  system  and  the  sliding  bank  estimator  are 
described  in  this  chapter.  The  true  system  is  a  second  or¬ 
der,  continuous- time  system  with  uncertain  parameters,  £  and 
from  which  noisy  sampled-data  measurements  of  the  posi¬ 
tion  type  variable  are  available.  The  sliding  bank  estima¬ 
tor  is  developed  to  provide  an  accurate  adaptive  estimate  of 
the  true  system  states.  • 

Several  issues  are  discussed  pertinent  to  "sliding" 
the  bank.  Five  decision  methods  are  given  for  changing  the 
bank,: 

a.  residual  monitoring 

b.  parameter  position  estimate  monitoring 

c. '  parameter  position  and  velocity  estimate  monitoring 

d.  probability  monitoring 

e.  parameter  covariance  monitoring 

Once  the  decision  is  made  to  change  the  bank,  the  bank 
can  either  be  moved  or  expanded/contracted.  When  moving  the 
bank,  the  probability  weightings  and  state  estimates  of  some 
of  the  filters  must  be  reset.  The  current  overall  estimate, 
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(t^)  is  used  to  reset  the  elemental  filter’s  state  estimate, 
while  the  probability  weightings  can  be  either  set  to  an  equal 
weighting  or  only  the  changed  elemental  filters  reset.  Addi¬ 
tionally,  a  set  of  felemental  filters  can  be  "warmed  up"  prior 
to  a  move  or  expansion  to  allow  transients  to  die  out. 

This  research  is  intended  to  investigate  the  effective¬ 
ness  of  these  various  decision-making  and  reset  methods. 
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Controller 


1 1 1 . 1  •  Introduction 

In  this  chapter,  three  "forced"  certainty  equivalence 
design  (9:241)  controller  schemes  are  outlined.  The  pur¬ 
pose  of  the  controller  is  to  regulate  the  system  to  the 
quiescent  state.  The  first  scheme  is  a  single  linear,  quad¬ 
ratic  cost,  (LQ)  full-state  feedback  controller,  fed  state 
estimates  by  the  sliding  bank  estimator.  The  controller 
gains  are  dependent  upon  the  value  of  the  parameter  estimate; 
thus,  the  controller  is  fed  both  state  and  parameter  esti¬ 
mates  by  the  sliding  bank  estimator.  The  second  3cheme,is 
an  approximation  to  the  first.  Instead  of  changing  the  con¬ 
troller  gains  accord  i  nr:  to  the  parameter  estimate,  fixed  gains 
are  used,  based  on  some  nominal  value  of  the  parameter  vector. 
The  third  scheme  is  a  sliding  bank  multiple  model  adaptive 
controller:  an  elemental  LQ  controller  is  tied  to  each  ele¬ 
mental  filter  of  the  sliding  bank  and  the  outputs  of  the  ele¬ 
mental  controllers  are  put  through  the  weighted  average. 

III. 2.  Basic  LQ  Controller  Structure 

The  basic  structure  of  each  of  the  controller  schemes 
is  similar,  iiach  employs  a  constant-gain  I,Q  full-state  feed¬ 
back  controller,  where  the  gainr.  are  dependent  upon  a  par¬ 
ticular  parameter  value. 

Given  the  stochastic  system 

x(t)  «  fcjc(t)  +  Bu( t )  +  Gw(t)  (III-1) 
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E^w(t)}  =  0 


E{w(t)w(t+r)}  =  Q8(r) 


and  the  quadratic  cost  function  to  he  minimized 


,T  * 


00 

J^i[xT(t)Wxx(t)  +  Wuu2(t)Jdt}  (III-2) 


the  solution  for  the  optimal  control,  assuming  full-state 
access,  is  the  LQG  regulator 


u(ti)  *  -Gcx(ti) 


(III-3) 


where  the  constant  gains,  0  ,  that  minimize  ,T  are  given  by 


(9:68-122) 


°C  -  [u  +  *  “T] 


(111-4) 


where  K  satisfies  the  algebraic  Riccati  equation 
c 


Kc  -  X  *  *TKc*  -  [bJk^  ;  ST]  Oc  (TXI-5) 


and 


X  »JtuV(Sti+1)Wx(t(r|ti)df 
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s  =J  i+1«t,T(r,ti)Wx3(>',ti)df 


)  is  the  state  transition  matrix 
from  t1  to  t2 

^’^ti+fV 

Note  that  Equation  (III-3)  is  also  the  solution  to 
the  deterministic  LQ  optimal  control  problem  with  no  driving 
noise  w(t),  and  that  if  the  assumption  of  full  state  access 
is  replaced  by  noise-corrupted  measurements  being  available, 
then  x(t. )  in  Equation  ( III— 3 )  is  replaced  by  x(t.  +  ]  generated 

by  a.  Kalman  filter.  This  certainty  equivalence  is  valid  if 
all  system  parameters  are  assumed  to  be  known  perfectly. 

?or  the  true  system  where 
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Gc  will  be  a  function  of  £  and  «: 
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-  G=U] 

where  a  . is  the  parameter  vector 


III. 3.  Single  Changeable-Gain  Contvoller 

In  this  scheme,  the  controller  gains  are  calculated 
based  on  the  value  of  (from  Equation  1-8).  The  con¬ 

trol  becomes 


L 


u(ti)  “  -Gc[a(ti)]x(ti+) 


(III-6) 


or  in  an  approximate  form  (to  reduce  computational  delay) 


u(ti)  *  -Gc[a(‘ti.1)]x(ti+) 
or 

'  u(ti)  *  -Gc[a(ti-1  )]x(ti*') 

Figure  III— 1  depicts  this  scheme. 

Rather  than  solve  Equation  ( III— 4 )  in  real  time  at  each 
sample  .time  for  a  new  value  of  aft^,  what  is  done  is  to  set 
up  a  table  of  G^a^J's,  one  for  each  point  in  the  discretized 
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igure  II 1-1 .  Changeable-Gain  Co: 


parameter  space,  and  interpolate  between  them.  If,  for  ex- 


The  interpolation  is  presented  pictorally  in  Figure  III-2. 


Figure  III-2.  Interpolation 

111*4-.  Single  Fixed-Gain  Controller, 

The  second  controller  structure  is  an  approximation  to 
the  first.  The  gains  are  not  changed  according  to  a^t^)  but 
are  based  on  a  nominal  value  of  the  oarameter  vector,  a„,. 
The  weighting  matricies,  w  and  V  ,  and  nominal  values  of  C 
and  (o  are  selected  so  that  the  controller  provides  adequate 
regulation  for  any  true  system  parameter  value.  (Note  that 
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selecting  anQn  may  be  a  non- trivial  task.)  This  single  fixed- 
gain  controller  receives  estimates  of  the  system  states  by  the 
sliding  bank  estimator  and  generates  the  control  from 

-  -OcfincnjitV) 

or  (for  reduced  computational  delay) 


U<V  =  “®c[— nom]  — ^  ^ 


where  Oc[anomj  is  computed  from  Equation  (III-4)  with 


-nom 


£  nom 
"nom 


This  is  a  reasonable  strategy  because  full-state  feedback 
controllers  are  inherently  robust,  and  the  adaptiveness  in  the 
estimator  is  used  only  to  produce  more  accurate  state  estimates 
to  this  one  set  of  robust  controller  gains.  Figure  III-3  de¬ 
picts  the  single  fixed-gain  controller. 

III. 5.  Sliding  Bank  iqultiple  Model  Adaptive  Controller 

This  controller  design  (9:23)  differs  from  both  of  the 
single  controller  gain  designs.  In  this  design,  a  separate 
elemental  controller  is  cascaded  with  each  of  the  elemental 
filters  of  the  sliding  bank.  The  controller  outputs  (instead 
of  the  ^(t^'s  are  put  through  the  weighted  average  (Section 
II.3.3).  The  elemental  controller  outputs  are 
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igure  I 11-3.  Fixed-Gain  Controller 


C III— 3 ) 
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where  a,  is  the  parameter  value  associated  with  the  filter/ 
controller,  in  the  bank.  The  overall  control  is 


9 

u(ti).«  £  “k^i^k^i^  (III-9) 

k=  1 

where  is  the  probability  weighting  from  2'quation  (II-9). 

Figure  III-4  depicts  the  sliding  bank  multiple  model  adap¬ 
tive  controller  design. 

III-6.  Summary 

The  three  controller  schemes  have  been  presented  in 
this  chapter.  The  relative  performance  and  computational 
burden  of  each  is  investigated  in  this  thesis. 
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Figure  III-4.  Sliding  Bank  Multiple  Model  Adaptive  Controller 


IV. 


Simulation 


IV. 1.  Introduction 

A  means  of  evaluating  the  performance  of  the  sliding 
bank  estimator/contr oiler  is  needed.  The  evaluation  is  pro¬ 
vided  by  a  computer  simulation  of  the  true  system  and  the 
sliding  bank  estimator/controller.  In  this  chapter,  the  simu¬ 
lation  is  outlined.  Included  is  a  discussion  of  Monte  Carlo 
analysis,  a  brief  discussion  of  the  software  used  to  accomplish 
the  sumulation  (see  Appendix  C  for  more  details  on  the  soft¬ 
ware),  and  finally  the  plan  for  analyzing  the  performance  of 
the  various  move/expand/contract  decision  schemes  and  control¬ 
lers. 

IV. 2.  Monte  Carlo  Analysis 

The  purpose'  of  a  Monte  Carlo  analysis  is  to  generate 
statistical  information  about  the  performance  of  the  estimator/ 
controller  under  study.  The  Monte  Carlo  analysis  essentially 
generates  many  samples  of  the  random  variables  of  interest 
and  uses  these  samples  to  compute  means  and  covariances. 

For  the  analysis  performed  in  this  thesis,  the  true' 
system  model  is  described  by  the  linear  time- invariant  sto¬ 
chastic  difference  equation 

where 

<$  is  the  state  transition  matrix  from  t^  .to  t^ 


is  the  control  input  matrix 
G^  is  the  noise  input  matrix 

In  this  model,  <J>,  Bd,  and  G^  are  all  functions  of  the  true 
parameter  vector  a^  \^here 


The  model  is  driven  by  both  the  known  control  u(t^_.j  )  and  a 
discrete  zero-mean  white  Gaussian  noise  w(t.  1)  of  covariance 
Noise-corrupted  measurements  of  the  system  states  are 
provided  to  the  estimator  by 


where 


zCi^)  *  Hx(ti)  +  v(ti) 


H  *  [l  0]  is  the'  measurement  matrix 


)  is  a  dli 
1  Gaussija: 


is  a  discrete  zero-mean  white 
Gaussijan  measurement  noise  of 
variarice  R. 


The  driving  noise  w(t.  1 )  and  the  measurement  noise 
v(ti)  are  provided  by  the  simulation.  A  zero-mean  Gaussian 
random  variable  with  a  variance  of  1  can  be  approximated  by 


(IV-1) 


where 


y.  is  a  random  variable  that  is  distributed  uniformly 
~1  between  0  and  1  (available  through  a  random  number 
generator) 


In  order  to  simulate  a  zero-mean  Gaussian  random  vector  with 
covariance  Qd,  the  following  operation  is  performed: 

w  •*  Dr 

where  the  elements  of  r  are  computed  by  Equation  (IV-1 )  and 


D  3  »  i*  6* » 


Qd  »  DDT 


The  true  system  and  estimator/controller  are  operated 
from  initial  time  tQ  to  final  time  tf  for  many  runs.  These 
runs  ' are  then  used  to  compute  the  sample  means  and  covariances 
of  any  random  variables  of  interest:,  the  number  of  runs  is 
chosen  large  enough  that  these  averages  over  N  samples  are 
good  approximations  to  ensemble  averages  (expectations). 

Figure  IV-1  depicts  a  simulation  of  the  estimator  alone. 
Here,  the  variables  of  interest  are  the  errors  e(t.)  between 
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the  true  system  states  x(t.)  and  the  estimates  of  the  states 

-S?  ♦ 

x(t.).  The  error  e(t.)  gives  a  measure  of  the  performance 

A#  >»  * 

of  the  estimator.  The  mean  of  e(td)  is  computed  by 
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where  N  is  the  total  number  of  runs  performed  in  the  Monte 

Carlo  analysis  and  e,,(t,)  is  the  value  of  e(t. )  during  the 

-“It  JL  ss  J- , 

k  run.  The  covariance  of  e(t.)  is  computed  by 

'C  **• 

E{[s(ti)  ■  E{4(*i)H[4Cti)  -  “ 


p  (t  )  2  _L  Ee  (t  )e£(t  )  .  JL^Ct  )M^(t  ) 

e  1  N-1  k=1  1  H-1^  1  ^  1 


In  order  to  study  the  estimator/controller  combination, 
an  appropriate  variable  of  interest  is  the  true  system  state 
x(t.),  since  in  this  study  it  is  desired  to  regulate  the  true 

"V 

system  to  the  quiescent  state.  Figure  IV-2  depicts  this.  It 
may  also  be  desirable  to  examine  the  control  input  uCt^)  in 
order  to  detect  unreasonable  control  levels.  The  means  and 
covariances  of  x(t.)  are  computed  in  the  same  manner  as  above: 
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Figure  IV-2.  Astiraator  and  Controller  Simulation 


2x(ti>  *  J,ik(V 


M 


p  (t  )  *  J~  E  -  — '•'ix(ti)^(ti) 

X  1  n-1  k*i-K  1  “K  1  K-1  x  1  ~X  1 


1 1  * ^ *  Software  Structure 

.  In  order  to  accomplish  the  Monte  Carlo  analysis,  two 
computer  programs  were  developed.  (For  a  detailed  discussion 
of  the  software,  refer  to  Appendix  C. )  The  first  program 
performs  the  simulation  runs  and  generates  the  data  from  each 
run.  The  second  program  reads  the  data  from  the  first  pro¬ 
gram,  computes  pertinent  means  and  covariances,  and  then 
creates  plots. 

The  first  program  consist:!  of  an  executive  routine  which 
calls  a  number  of  subroutines.  The  executive  contains  two 


main  loops.  The  inner  loop  accomplishes  a  single  run  of  the 
system  from  t  to  t^.  Within  the  inner  loop  are  calls  to 
subroutines  that  propagate  the  true  system  from  one  sample 
time  to  the  next,  propagate  the  filters  in  the  bank  from  one 
sample  time  to  the  next,  take  a  measurement  of  the  true  sys¬ 
tem  states,  update  the  filters,  calculate  the  control,  make  the 
decision  as  to  whether  or  not  to  move/expand/contract  the 
bank,  and  finally  output  the  variables  of  interest  to  a  data' 
file.  The  outer  loop  performs  the  number  of  runs  necessary  for 
the  Monte  Carlo  analysis,  setting  all  variables  to  their  proper 
initial  value  prior  to  the  start  of  each  run.  Inputs  to  the 
first  program  are  true  system  parameters,  initial  probability 
weightings,  and  initial  filter  states.  Additional  inputs  are 
the  particular  move /expand /con tract  decision  method  (Sections 
II. 4. 1.1  through  II. 4. 1.6)  and  the  associated  thresholds. 

The  second  program  performs  the  analysis  of  the  data 
created  by  the  first  program.  The  means  and  covariances  of 
the  variables  .of  interest  are  computed  for  each  sample  time 
from  t  .  to  tf.  Plots  of  the  means  +  1<r  are  then  generated, 
w,here  o  is  the  standard  deviation  of  the  variables  of  interest. 

I V . 4 * .  Simulation  Plan 

In  order  to  study  the  performance  of  the  sliding  bank 
estimator/controller  in  a  systematic  manner,  the  performance 
analysis  is  divided  into  two  parts.  First,  the  performance  of 
the  estimator  alone  (i.  e.,  without  feedback  control)  is  eval¬ 
uated.  Upon  completion  of  the  estimator  evaluation,  the  "best'* 


estimator  is  used  in  conjunction  with  each  oi  the  controllers 
to  determine  the  best  adaptive  estimator/controller. 

The  performance  analysis  of  the  estimator  alone  is 
accomplished  by  driving  the  true  system  with  a  zero-mean  white 
noise  alone  and  then  with  white  noise  plus  a  dither  signal 
for  each  of  the  various  move/exparid/contract  decision  schemes. 
The  dither  signal  is  used  to  enhance  system  identif iability , 
over  the  noise-only  case,  by  sufficiently  and  persistently 
exciting  the  true  system  modes  with  a  known  input.  The  analy¬ 
sis  is  performed  with  the  true  system  parameters  taking  oh  a 
number  of  different  values  within  the  parameter  space.  The 
parameters  will: 

a.  be  constant  over  t  to  tf  and  equal  to  one  of  the 
discretized  points  in  the  parameter  space;  or 

b.  be  constant  over  t  to  tf  and  between  discretized 
points  in  the  parameter  space;  or 


c.  undergo  a  jump  in  value  at  t.  where  t  <  t .  <  tf;  or 
i  d.  vary  continuously  over  tQ  to  t^. 

performance  analysis  for  these  various  true  parameter  cases 
intended  to  give  an  indication  of  how  well  the  estimator 
forms  when  the  true  parameter  is  at  one  of  the  discretized 
ameter  points  vs.  when  the  true  parameter  is  between  dis- 
■;ized  parameter  points  (i.  e.,  no  one  filter  in  the  bank 
"perfectly  matched”  to  the  real  world  environment).  Ad- 
:.onally,  the  determination  of  how  well  the  estimator  adapts 
jumps  in  parameter  values  (as  due  to  catastrophic  changes 
:i  system)  and  how  well  the  estimator  can  track  slowly 
;ring  parameters  (as  due  to  an  aerospace  vehicle  changing 
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its  operating  point  within  its  flight  envelope)  can  he  ac¬ 
complished.  Table  IV- 1  displays  the  estimator-only  performance 
analysis  plan. 

Upon  completion  of  the  estimator-only  study,  the  results 
will  be  qualitatively  analysed  to  determine  the  "best"  move/ 
expand /contract  decision  scheme  (as  developed  in  Sections  II. 
4.1.1  through  II. 4. 1.6).  The  determination  of  "best”  will  be 
based  on  fastest  state  and  parameter  acquisition  time,  lowest 
state  estimate  error  biases,  and  lowest  state  estimate  error 
variances.  Conclusions  will  be  drawn  about  the  performance  of  1 
the  various  move-the-bank  decision  methods,  whether  or  not  filter 
warm-up  (Section  II. 4. 2)  offers  any  performance  improvement, 
and  whether  it  is  more  appropriate  to  have  an  acquisition 
cycle  (Section  II. 4. 1.5)  or  simply  to  let  the  bank  mcve  itself 
to  the  appropriate  region  of. the  parameter  space.  Corresponding 
to  the  true  parameter  point  position.  The  best  move  decision 
method  should  consistently  have  the  fastest  acquisition  time, 
lowest  variances,  and  lowest  bias  errors.  If  filter  warm-up 
is  to  be  effective,  it  should  substantially  reduce  state  esti¬ 
mate  error  biases  and  variances  in  addition  to  improving 
acquisition  times.  The  acquisition  cycle  should  significantly 
reduce  the  time  required  to  establish  precise  state  and  para¬ 
meter  estimates  to  prove  its  effectiveness. 

When  the  best  move/expand/contract  decision  method  h 
been  determined,  the  estimator  (using  that  method)  will  then 
be  used  in  conjunction  with  each  of  the  following  controllers: 

a.  single  changeable-gain  controller  (Section  III. 3) 
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The  covariance  monitoring  acquisition  cycle  is  to  be  used 
with  the  best  of  the  four  move  decision  modes. 


b.  single  fixed-gain  controller  (Section  III. 4) 

c.  sliding  bank  multiple  model  adaptive  controller  (Sec¬ 
tion  III. 5) 

As  with  the  estimator- only  analysis,  the  estimator/controller 
combinations  will  be  evaluated  under  various  true  parameter 
characteristics.  Table  IV-2  is  the  estimator/controller  analy¬ 
sis  plan. 

17.5.  Summary 

The  simulation  pf  the  sliding  bank  estimator/controller 
was  discussed  in  this  chapter.  Monte  Carlo  analysis,  simulation 
software,  and  the  simulation  plan  were  presented.  The  results 
of  the  simulation  are  presented  in  the  next  chapter. 


Controller  Analysis  Plan 


> 

■ 

B 

£ 

SB 

3 

^■1 

-p 

^■1 

3 

*“D 

e 

-'T'^S  I 

3 

HI 

£ 

^■1 

3 

HI 

P 

CD  ' 

3 

£ 

Eh 

P 

P 

P 

P 

p 

£ 

CD 

rH 

3 

rH 

•H 

3  O 

3 

H  £ 

bfl 

P-P 

1 

£ 

•H  C 

CD 

•P  O 

rH 

rH  O 

ja 

05 

3 

£ 

05 

bO 

S  <D 

CD 

CD 

» 

> 

rH 

ta 

03 

Jtf  -H 

rH 

c 

<D 

E  -P 

o 

o5  £ 

X  £ 

3  P 

£ 

S  0) 

•H  CD 

£3  3 

4-> 

3  rH 

«M  H 

t3 

1  £ 

rH 

rH 

W  3 

o 

3  o 

iD  O 

£ 

rJ> 

rH  H 

iH  P 

■H  rH 

MP 

bflp 

03  3 

£  E 

£  £ 

*H  'TS 

•H  O 

•H  O 

H  O 

03  O 

03  S 

03 


3 

03 

CO 

3 

•H 

CO 

P 

•H 

3 

P 

£ 

3 

O 

£ 

3 

O 

■H 

m 

03 

O 

•H 

03 

P 

£ 

3 

rH 

3 

3 

7t 

3 

p  m 

C3P 

3  P 

3 

£ 

P  £ 

•H 

-H 

03 

O 

03  O 

£ 

P 

£  P 

3 

3 

£ 

£ 

P 

3 

P  3 

£  P 

E  P 

3 

P 

3 

e 

■51 

03 

3 

m  ns 

£ 

£ 

£  £ 

O 

3 

O  3 

O 

P 

O  P 

M 

a 


•  •  ••  •«  •• 

P  - « - *3  > 


r. 


f- 


5 


V.  Results 


V. 1 .  Introduction 

This  chapter  presents  the  results  of  the  Monte  Carlo 
simulation.  The  initial  goal  of  the  simulation  was  to  deter¬ 
mine  the  "best"  of  the  various  move/expand/contract  decision 
methods  for  the  sliding  bank  multiple  model  adaptive  estimator 
Cnee  the  best  estimator  move  scheme  was  determined,  that 
scheme  was  used  for  the  estimator  in  conjunction  with  each  of 
the  three  controller  designs. 

The  true  system  driving  noise  strength  used  throughout 
the  simulation  was  Q  =  1.0  (refer  to  Equation  H-3).  The 
measurements,  taken  every  0.01  second,  were  corrupted  by  a 
discrete-time  zero-mean  white  Gaussian  noise  with  a  variance 
(•’.  of  R  a  0.01.  Each  decision  method  was  exercised  with  the  true 

system  parameters  being  defined  as:  equalling  one  of  five  dif 
ferent  discretized  parameter  points,  equalling  one  of  two  dif¬ 
ferent  points  that  were  between  discretized  parameter  points, 
undergoing  a  jump  change,  and  varying  slowly  (see  Table  V-1). 
The  particular  parameter  points  chosen  in  Table  V-1  were 
selb''ted  to.  cover  the  parameter  space:  one  point  near  the 
center,  others  on  the  boundary  (where  the  bank  cannot  center 
itself  , on  the  true , parameter  point) ,  some  points  near  the 
boundary  (where  the  bank  can  center  itself  on  the  true  para-' 
meter  point),  and  points  between  discretized  parameter 
values. 

The  center  of  the  bank  at  the  beginning  of  each  run, was 
always  placed  at  the  discrete  parameter  space  coordinates 
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TA3L3  7-1 
True  Parameters 


>. 

c 

(o 

(rad/sec) 

discretized  parameter 
space  coordinates 

1 

0.0000 

10.43 

(1,  3) 

2 

0.1111 

48.65 

(2,  9) 

3 

0.4444 

13.54 

(5,  4) 

4 

0.S889 

8.12 

(9,  2) 

5 

1.00C0 

62.83 

(10,  10) 

6 

0.0700 

msm 

7 

0.9300 

B9 

8 

0.0700 

jumps 

0.9300 

9.00 

to 

j  41.00 

.  9 

0.0700  1  9.00 

varies  to 

0.9300  j  41.00 

(5,  5),  corresponding  to  £  =  0.4444  and  <o  -  17.48  rad/sec. 

The  true  system  was  quiescent  at  the  beginning  of  each  run 
(however,  the  option  of  an  excitation  input  to  enhance  identi- 
fiability  was  available )i  The.  initial  state  estimate  for 
each  elemental  filter  was  x,K(0)  a  o  and  the  initial  proba¬ 
bility  weightings  were  pk(0)  a  1/9  for  k  »  1,...,9. 

The  Monte  Carlo  analysis  is  based  on  100  runs  of'  the 
system,  for  0<t<8  seconds.  The  same  seed  number  for  the 
random  number  generator  was  used  for  each  100-run  simulation.1 

Section  7.2  describes  estimator  performance  and  Section 
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V.3  discusses  the  controller  performance.  Finally,  Section 
V.4  presents  controller  computational  loading  comparisons. 

V.2.  Estimator  performance 

The  performance  of  the  sliding  bank  estimator,  operating 
under  the  various  move/expand/contract  decision  methods,  is 
discussed  in  this  section.  The  ability  of  the  sliding  bank 
estimator  to  provide  adequate  state  estimates  is  the  criterion 
used  to  determine  the  best  performing  decision  method*  The 
state  estimate  errors,  for  each  of  the  decision  methods,  are 
compared  to  a  performance  bound  of  a  single  kc*.Lman  filter  that 
has  artificial  knowledge  of  the  true  parameters.  Figures  A-la 
through  A-lg  of  Appendix  A  are  plots  of  the  state  estimate 
i.TPorn  of  the  benchmark,  a  single  Kalman  filter.  /.n  attempt 
was  also  made  to  compare  the  performance  of  the  sliding  bank 
estimator  to  that  of  the  full  bank  multiple  model  adaptive 
estimator.  However,  the  full  bank  approach  required  such  an 
excessive  amount  of  computation  time  that  only  ten  Monte  Carlo 
runs  could  be  performed.  The  resulting  plots  wore  so  noisy 
(because  of  the  low  number  of  runs)  that  comparisons  were  im¬ 
possible. 

For  each  ol  the  decision  methods,  the  true  system  was 
first  driven  by  the  white  noise  signal  alone.  However,  due  to 
t.ue  relatively  low  driving  noise  strength  arid  the  fact  that 
only  noi3e-corrupted  measurements  of  the  position  type  variable 
were  available,  the  estimator  experienced  considerable  dif¬ 
ficulty  identifying  the  true  system  parameters.  Additionally, 
the  difficulty  in  system  identification  is  not  apparent  when 
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comparing  the  state'  estimate  error  plots  of  the  sliding  bank 
estimator  to  those  of  the  benchmark.  Because  the  true  system 
modes  are  not  sufficiently  excited  by  the  noise  signal  and 
because  the  measurement"  noise  strength  is  quite  low  relative 
to  the  driving  noise  strength,  the  difficulty  in  system  iden¬ 
tification  appears  to  have  little  effect  on  the  estimator’s 
ability  to  provide  good  state  estimates,  when  the  true  system 
is  driven  by  the  noise  signal  alone.  As  a  result,  with  the  ’ 
noise  signal  alone  driving  the  true  system,  there  is  little  or 
no  basis  of  comparison  between  the  various  decision  methods. 

In  order  to  aid  system  identification,  the  true  system 
was  next. driven  by  the  noise  signal  plus  a  20  Hz  square  wave 
dither  signal  with  an  amplitude  of  25.  The  dither  signal  was 
not  chosen  through  a  rigorous  analysis  of  optimal  inputs  for 
system  identification,  as  that  topic  is  beyond  the  scope  of 
this  effort,  but  rather  oy  several'  trial  and  error  iterations. 
The  20  Hz  square  wave  signal  was  found  to  enhance  the  estima¬ 
tor’s  ability  to  identify  the  parameters  for  all  true  parameter 
■points  exercised  in  the  simulation.  The  dither  signal  had  the 
additional  benefit,  from  the  standpoint  of  decision  method 
comparisons,  of  indicating  in  the  state  estimate  error  plots 
whether  or  hot  the  estimator  had  identified  the  system  para¬ 
meters.  When  the  sliding  bank  estimator  has  properly  iden¬ 
tified  the  true  system  parameters,  the-  bias  errors  of  the 
estimator  disappear  and  the  effects  of  the  dither  signal  are 
no  longer  present.  While  it  may  appear  that  performance  is 
degraded  with  the  dither  signal  when  comparing  the  dither  vs. 


non-dither  state  estimate  error  plots,  system  identification 
is  in  fact  improved.  Without  the  dither  signal,  system  iden¬ 
tification  is  degraded  and  the  state  estimate  error  plots  do 
not  clearly  depict  what  is  happening.  With  the  dither  signal, 
system  identification  is  enhanced,  and  it  becomes  quite  evident 
from  the  state  estimate  error  plots  how  well  the  sliding  bank 
estimator  is  performing.  A  further  explanation  of  the  dif¬ 
ference  between  the  state  estimate  error  plots  of  the  dither 
vs.  non-dither  cases  can  be  found  through  examination  of  the 
relative  magnitudes  of  the  system  drivers.  The  dither  mag¬ 
nitude  is  25.0  while  the  rms  white  noise  value,  is  only  Qd  as 
Q  At  =  0.01. 

Plots  of  parameter  estimate  errors  for  two  of  the  true 
parameter  points  exercised  that  demonstrate  the  effect  of 
the  dither  signal  on  system  identification  can  be  found  in 
Appendix  B.  In  Figures  B-la  through  B-ld,  residual  monitoring 
was  used  to  move  the  bank.  Figures  B-Ia  and  B-lb  are  for  the 
case  of  the  true  parameters  equalling  ((,  w)  *  (1.0,  62.83),' 
with  the  true  system, driven  by  the'  noise  signal  alone  and  by 
the  noise  plus  dither  signal,  respectively.  In  Figures  B-lc 
and  B-ld,  the  true  parameters  are  (£,  «)  *  (0.07,  9.0).,  In 
Figures  B-2  through  B-5,'  parameter  position  estimate,  parameter 
position  and  velocity  estimate,  probability,  and  probability 
plus  covariance  monitoring  were  used  to  move  the  bank.  These 
figures  readily  demonstrate  the  enhancement  of  parameter  iden¬ 
tification  when  the  dither  signal  is  applied. 

The  primary  objective  of  this  effort  is  not  to  design  a 
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good  parameter  estimator,  but  instead  to  design  a  good  state 
estimator.  Hence,  the  state  estimate  errors  were  chosen  as 
the  basis  of  comparison  for  the  various  decision  methods.  In 
the  discussions  to  follow,  the  state  estimate  error  plots,  ' 
with  the  true  system  driven  by  the  noise  plus  dither  signal, 
are  used  to  compare  the  performance  of  the  various  decision 
methods.  The  primary  figure  of  merit  used  is  acquisition  time. 
This  is  defined  as  the  time  at  which  the  state  estimate  errors 
of  the  sliding  bank  estimator  match  the  state  estimate  errors 
of  the  benchmark  to  four  significant  figures. 

Section  V.2.1  presents  a  discussion  of  threshold  setting 
and  Sections  7.2.2  through  V.2.6  discuss  the  individual  per¬ 
formance  of  the  various  decision  methods.  Section  V.2.7  pre¬ 
sents  the  comparisons  between  the  performance  of  the  various 
decision  methods. 

7.2.1.  Threshold  Setting.  Each  of  the  move/expand/con¬ 
tract  decision  methods  required  the  determination  of  an  ap¬ 
propriate  threshold  level  within  the  decision  logic.  The  thres¬ 
hold  chosen  was  required  to  provide  adequate  performance  for 
each  of  the  true  parameter  points  exercised.  It  should  be 
noted  that  the  thresholds  have  a  more  pronounced  effect  on 
where  the  bank  is  centered  than  on  where  a(t. )  is  located. 

This  is  due  ta  the  manner  in  which  the  probability  weightings 
are  calculated  when  the  bank  is  moved  (Section  II. 4. 2  and  Equa¬ 
tions  tl-11  and  11-12).  Since,  as  a  minimum,  four  of  the  fil¬ 
ters  will  retain  the  probability  weightings  and  ak  values  that 
they  had  before  the  move,  some  continuity  of  the  £t(t^)  cal- 


60 


culation  (Equation  1-8)  is  maintained  during  a  move. 

As  examples  of  threshold  level  characteristics,  para¬ 
meter  estimate  error  plots  for  a  single  run  simulation  are 
included  in  Appendix  D.  The  appendix  contains  three-  plots  for 
each  decision  method:  one  with  the  threshold  set  too  high, 
one  with  the  threshold  set  at  the  selected  value,  and  one  with 
the  threshold  set  too  low.  All  plots  are  for  the  true  para¬ 
meters  equalling  (£,  to)  *  (0.0,  10.48)  with  the  true  system 
driven  by'  the  noise  signal  plus  the  dither  signal. 

The  threshold  level  selected  for  the  residual  monitoring 
move  method  (Section  II. 4. 1.1)  was  7.0.  When  the  smallest  of 
the  nine  likelihood  quotients  (Equation  11-10)  exceeds  7,0, 
the  bank  is  moved  in  the  direction  of  the  elemental  filter 
with  the  smallest  likelihood  quotient,  '.'hen  the  threshold  is 
set  too  high,  the  sliding  bank  takes  longer  to  identify  the 
system  parameters.  (  Compare  figure  h-eu  where  the  threshold 
is  set  at  14.0  to  figure  B-6b  where  the  threshold  is  set  at 
7.0.)  When  the  threshold  is  set  too  low,  the  sliding  bank 
fails  to  maintain  "lock”  on  the  true  parameters.  (Compare 
figure  B-6c  where  the  threshold  is  set  at  1.0  to  Figure  B-6b.) 

Parameter  position  estimate  monitoring  (Section  II. 4. 1.2) 
required  a  threshold  level  of  0.04.  './hen  the  . estimated  para¬ 
meter  position  (Equation  1-8)  is  farther  than  0.04  from  the 
center  of  the  bank,  the  bank  is  moved  in  the  direction  of  the 
estimated  parameter  position.  Again,  when  the  threshold  is 
too  high,  as  in  Figure  M-7a,  where  it  is  set  at  0.111,  the 
bank  takes  longer  to  move  to  the  appropriate  region  of  the 
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parameter  space.  When  the  threshold  is  set  too  low,  it  also 
takes  longer  to  acquire  the  true  parameters.  Additionally, 
the  sliding  bank  tends  to  oscillate  between  discretized  para¬ 
meter  points  (see  Figure  E-7c,  where  the  threshold  is  set  at 
0.008). 

A  level  of  0.04  v  is  also  chosen  for  the  threshold  of  the 
parameter  position  and  velocity  estimate  monitoring  decision 
method  (Section  II. 4. 1.3).  When  the  predicted  position  (one 
sample  period  ahead)  of  the  parameter  position  estimate  is  far¬ 
ther  than  0.04  from  the  center  of  the  bank,  the  bank  is  moved 
in  the  direction  of  the  predicted  parameter  position  estimate. 
When  the  threshold  is  set  too  high  (0.111),  as  in  Figure  B-8a, 
the  sliding  bank  takes  longer  to  acquire  the  true  parameters 
than  when  it  is  set  at  the  proper  level  as  in  Figure  B-8b. 

Here,  a  tradeoff  was  made  between  acquisition  time  and.  the 
tendency  of  the  bank  to  loose  lock  under  this  decision  method; 
the  excursion  from  the  true  parameter  position  at  around  6.5 
seconds  is  larger  in  Figure  3-3b  than  in  Figure  3-Sa.  '  When  the 
threshold  is  set  too  low  (0.01  for  example),  as  in  Figure  3-8c, 
the  bank  has  an  even  greater  tendency  to  loose  lock. 

■Probability  monitoring  (Section  II. 4. 1.4)  required  a 
threshold  of  0.05.'  When  the  largest  probability  weighting  on 
any  of  the  elemental  filters1  exceeds  0.05,  the  bank  is  moved 
in  the  direction  of  that  filter,  unless  that  filter  is  the 
center  filter.  With  this  decision  method,  as  the  threshold 
■is  decreased  from  high  values  to  low  values  performance  im¬ 
proves.  Compare  Figure  B-9a,  where  the  threshold  is  set  at 
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0.8,  with  Figure  B-9b.  No  improvement  in  performance  is 
gained  over  the  selected  value  of  0.05,  however,  when  the 
threshold  is  set  at  its  lowest  value  of  0.0  (compare  Figure 
B-9c).  Essentially,  with  these  low  threshold  values,  the 
bank  moves  anytime  the  probability  weightings  on  the  perimeter 
elemental  filters  exceed  the  weighting  on  the  center  filter. 

A  different  acquisition  strategy  than  that  of  the  other 
decision  methods  is  used  with  covariance  monitoring.  With 
the  other  methods,  the  spacing  between  the  discretizations  in 
parameter  space  of  the  elemental  filters  of  the  bank  is  con¬ 
stant  and  at  its  smallest  value  for  the  entire  run.  The  slid¬ 
ing  bank  starts  the  run  with  its  center  near  the  center  of  the 
parameter  space  ana  then  uses  the  various  decision  modes  to 
move  the  bank  to  the  proper  position  in  the  parameter  space, 
i.  e.,  corresponding  to  the  true  parameter  point.  The  co- 
variance  monitoring  acquisition  strategy  on  the  other  hand 
does  not  keep  the  spacing  the  same  for  ail  time.  The  spacing 
is  initially  set  such  that  the  sliding  bank  covers  nearly  the, 
entire  parameter  space  (a  coarse  discretization  for  acquisi¬ 
tion).  The  covariance  of  the  parameter  estimate, is  then  used 
to  contract  the  bank  as  appropriate,  (defer  to  ,’jection  II. 4.. 
1.5.)  In  this  v/ay ,  the  true  parameter  would  always  be  within 
.the  region  spanned  by  the  large  initial  cl  id  irig  bank,  perhaps 
offering  improved  ini  tial  performance  ov-.-r  the  other  'methods, 
when  the  true  parameter  initially  is  out;  it*.-  the  'Space  spanned 
by  the  small  initial  sliainp  bank  (except  when  the  true  para¬ 
meter  point  is  located  .it,  (b,  1)  in  pi  route  ter  spu-e'). 


The  scheme  used  in  the  simulation,  was  to  contract  the 
spacing  between  discretizations  of  the  elemental  filters  in 
two  steps.  The  bank  initially  has  a  spacing  of  four  between 
discretizations  of  elemental  filters,  as  in  Figure  V-la.  When 
the  covariance  of  the  parameter  estimate  drops  below  the  thres¬ 
hold  level  (comparison  to  a  scalar  threshold,  is  discussed  in 
the  next  paragraph) ,  the  bank  then  contracts  to  an  intermediate 
spacing  of  two,  as  in  Figure  V-lb.  Finally,  when  the  covariance 
of  the  parameter  estimate  drops  below  a  secor  oreshold,  the 
bank  contracts  to  the  finest  discretization,  .  spacing  of  one, 
as  in  Figure  V-lc.  When  the  bank  contracts,  it  contracts  to 
the  quadrant  of  the  bank  before  contraction  that  contains  the 
estimated  parameter  point  position.  This  ensures  that  four 
filters  of  the  bank  before  contraction  remain  in  the,  bank  after 
contraction,  in  order  to  minimize  the.  impact  of  Initial  tran¬ 
sients  in  the  state  estimators  (see  Figure  V-2).  Another 
option  would  be  to  contract  the  bank  such  that  its  center  is 
the  discretized  parameter  point  nearest  to  a,  but  this  would 
have  the  disadvantage  of  all  of  the  nine  filters  generally 
going  through  an  .initialization  transient.  , 

One  snould  note  that  the  covariance  of  the  parameter 
estimate  is  a  two-by-two  matrix  (Equation  1-9 )•  In  order  to 
compare  this  matrix  to  the  threshold  level,  a  scalar  value 
associated  with  the  matrix  is  needed.  A  function  of  the  two 
diagonal  elements  (the  variance  of  the  £  estimate  and  tie  ' 
variance  of  the  cu  estimate)  is  a  strong  candidate.  For  the 
simulation,  what  was  used  was  the  larger  of  the  two  diagonal 
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Figure  V-2 .  Bank  Contraction 

elements,  after  performing  an  inverse  mapping  on  the  <u  estimate 
variance  to  give  both  elements  the  same  relative  magnitude. 

The  spacing  between  adjacent  £  parameters  is  0.1111,  while  the 
spacing  between  adjacent  <u  parameters  is  dependent  upon  where 
they  are  in  the  parameter  space  (recall  that  the  to  parameters 
are  discretized  logarithmically).  However,  the  difference 
between  the  logarithms  of  adjacent  frequencies  (in  Hz)  is 
0.1111: 

<  > 

|log(f1)  -  log(f2)|  -  0.1111  , 

where  and  f2  are  adjacent  frequencies,  or  since  <o  *  2irf 

I 

log  — L  -  log  -=•  .  -  0.1111 

1  2 rt  2»  \ 

In  order  to  force  the  relative  magnitudes  of  the  Pa  and  Pa 
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terms  to  be  the  same,  an  inverse  mapping  of  the.o>  parameter 

must  be  performed.  In  other  words,  the  problem  is  rescaled  so 

that  equal  Pa  and  Pa  correspond  to  equal  distances  as  de- 
-1 1  - 22  *  - 

picted  on  the  parameter  space  plots  of  Figures  V-1  and  V-2. 

From  Equation  (1-9)  we  have 


-22  k: 


cliK  '  *2(ti>] 


where  the  order  of  the  <o k  -  a>(ti)  terms  vary  according  to  their 

relative  location  in  the  parameter  space.  A  modified  Pa  that 

=22 

will  have  the  same  relative  magnitude  of  Pa  is 
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The  bank  is  contracted  when 
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where  T  is  the  contract  threshold. 

The  threshold  levels  used  for  the  covariance  monitor¬ 
ing  acquisition  cycle  were  0.08  for  the  contraction  from  the 
coarse  discretization  to  the  intermediate  discretization,  and 
0.0375  for  contraction  from  the  intermediate  discretization 
to  the  final  discretization.  If  the  thresholds  were  set  too 
high,  as  in  Figure  3-1 Oa,  where  they  are  set  at  0.15  and  0.o6, 
the  bank  contracts  too  soon,  before  a  good  estimated  parameter 
position  is  available,  and  frequently  contracts  to  the  wrong 
quadrant,  leaving  the  bank  in  no  better  position  than  it  would 
have  been  at  the  beginning  of  a  run  without  the  acquisition 
cycle,  'ihen  the  thresholds  are  set  too  low  as  in  Figure  B-10c,. 
where  they  are  set  at  0.003  and  0.0007,  the  bank  does  not  con¬ 
tract  until  well  into  the  run,  degrading  performance  while  it 
is  at  coarser  discretizations. 

An  additional  threshold  was  needed  for  the  covariance 
monitoring  acquisition  cycle.  The  bank  was  given  the  option 
of  expanding  in  order  to  handle  the  case  of  jump  parameters. 
V/hen  the  bank  expands,  It  is  set  at  the  initial  coarse  dis¬ 
cretization  with  its  center  at  (5,  5).  The  probability 
weightings  for  each  elemental  filter  are  reset  to  1/9  and 
the  x^’s  set  to  x.  Essentially,  the  sliding  bank’  starts  the 
acquisition  cycle  over  when  an  expand  decision  is  made.  The 
expand  decision  is  governed  by  residual  monitoring  (Section 
II. 4. 1.1).  Residual  monitoring  is  used  because  the  needed 
information  (that  state  estimates  have  gone  awry)  i3  not 
available  from  either  the  covariance  of  a  or  £  itself,  v/hen 
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the  smallest  of  the  likelihood ' quotients  exceeds  the  expand  ' 
threshold,  the  bank  expands.  The  expand  threshold  value  used 
in  the  simulation  was  25. G  (Figure  B-llb).  V/hen  the  expand 
threshold  was  set  too  high  (1000.),  it  waits  too  long  after 
the  parameters  have  undergone  a  jump  in  value  before  expanding, 
thereby  degrading  performance  (see  Figure  B-lla).  When,  the 
expand  threshold  was  set  too  low  (at  7.0  for  example),  the  bank 
expands  inappropriately  during  the  run  (see  Figure  E-llc). 

V/hen  filter  warm-up  is  used  (Section  II. 4. 2),  an  ad¬ 
ditional  set  of  thresholds  are  needed.  In  determining  the 
thresholds  for  filter  warm-up,  care  was  taken  not  to  set  the 
warm-up  thresholds  too  low,  as  this  would  have  meant  that  the 
wrong  set  of  filters  would  consistently  be  warmed,  up  (i.  e., 
the  "move11  decision  would  later  go  to  a  different  set  of  fil¬ 
ters)  or  that  the  estimator  would  frequently  change  the  fil¬ 
ters  being  warmed  up,  both  having  the  effect  of  not'  warming  up 
any  filters  at  all  despite  the  additional  computational  load¬ 
ing  and  complexity.  The  warm-up  threshold  also  could  not  be 
set  too  close  to  the  move  threshold,  as  thi3  would  mean  .that 
the  decision  to  warm  up  filters  would  be  made  concurrently 
with  the  move  decision,  again  having  the' effect  of  not  warm¬ 
ing  up  any  filters.  Table  V-2  summarises  the  move  and  warm¬ 
up  .  thresholds  used  in  the  simulation.  Note  that  0.0  was 
used  as  the  warm-up  threshold  for  probability  monitoring. 

Because  the  move  threshold  is  so  low  and  because  performance 
improves  when  the  threshold  is  lowered,  the  lowest  possible 
value  of  0.0  i3  an  appropriate  choice  for  the  warm-up  threshold. 
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Thresholds 


decision  method 

move 

warm-up 

residual  monitoring 

7.0 

3.0  ■ 

parameter  position 
,  estimate  monitoring 

0.04' 

0.02 

parameter  position  and 
velocity  estimate 
monitoring 

C.04  • 

0.02 

•  probability  monitoring 

0.05 

0.0 

covariance  monitoring 
coarse  -  intermediate 

0.08 

0.1 

covariance  monitoring 
intermediate  -  fine 

0.0375 

0.05 

covariance  monitoring 

25.0 

not 

expand 

used 

V.2.2.  Residual  Monitoring;.  Figures  A-la  through  A-lg 
of  Appendix  A  are  plots  of  tne  state  estimate  errors  of  the 
oenchmark,  a  single  Kalman  filter  that  has  artificial  knowled 
of  the  true  parameters.'  Figures  Ar2d  through  A-2i  are  plots 
of  the  state  estimate  errors  of  the  sliding  bank  estimator 
using  residual  monitoring  to  move  the  bank,  with  the  true 
system  driven. by  the  noise  signal  alone.  When  these  are  com- 
parea  to  Figures  A-la  through  A-lg,  it  is  seen  that  there  are 
two  fewer  benchmark  plots  than  sliding  bank  plots;  there  are 
no  benchmark  plots  for  the  cases  of  jump  parameters  and  vary¬ 
ing  parameters  due  to  computational  resource  limits.  However, 


bO ' 


the  jump  parameter  case  and  the  varying  parameter  case  start 
and  end  with  the  same  parameters  as  in  benchmark  Figures  A-lf 


and  A-lg  respectively,  so  there  is  some  basis  of  comparison 
for  this  and  all  other  proposed  filter  designs. 

As  was  mentioned  previously,  Figures  A-2a  through  A-2i 
do  not  shed  significant  light  on  the  sliding  bank’s  perfor¬ 
mance.  With  the  exception  of  Figure  A-2a,  where  the  true 
parameter  point  is  at  (1,  3),  there  is  little  difference  be¬ 
tween  the  sliding  bank  plots  and  the  benchmark  plots.  In 
Figure  A-2a,  the  sliding  bank  failed  even  to  come  close  to 
identifying  the  parameters,  so  that  its  poor  performance  is 
apparent  even  on  the  state  estimate  error  plot  with  the  true 
system  driven  by  the  noise  signal  alone. 

Figures  A-3a  through  A-3i  are  the  state  estimate  error 
plots  with  the  true  system  driven  by  the  noise  plus  the  dither 
signal.  V/hen  the  sliding  bank  estimator  has  properly  iden¬ 
tified  the  true  system  parameters,  the  bias  errors  of  the 
estimator  disappear  and  the  effects  of  the  dither  signal  are 
no  longer  present.  In  Figure  A-3.c,  the  parameters  are  iden¬ 
tified  very  rapidly  and  the  graphs  match  the  benchmark  of  Fig¬ 
ure  A-3a  for  nearly  the  entire  8  second  interval.  (Recall 
that  the  sliding  bank  is  initially  centered  at  (5»  5)  and  in 
Figures  A-lc  and  A-3c,  the  true  parameter  is  at  (5,  4).)  In 
Figure  A-3d,  the  parameter  is  almost  identified  within  two 
seconds,  but  a  slight  bias  error  still  remains  over  the 
remainder  of  the  interval.  In  this  run,  the  true  parameter  is 
never. fully  identified;  the  sliding  bank  never  centers  itself 
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on  (9,  2),  the  true  parameter  position.  The  true  frequency 
is  identified  after  two  seconds  but  the  true  damping  ratio 
is  never  identified.  In  Figure  A-3e,  the.  performance  is  poor 
over  the  entire  eight  second  interval.  Again,  the  true  fre¬ 
quency  is  identified  rapidly,  but  again  the  damping  ratio  is 
never  identified.  Figure  A-3f  and  A-3g  display  the  errors  for 
the  case  of  the  true  parameters  lying  between  discretized 
parameter  points.  In  Figure  A-3f»  the  sliding  bank  moves  to 
the  vicinity  of  the  true  parameter  point  in  just  over  one 
second  and  in  Figure  A-3g»  in  just  over  two  seconds.  For  both 
A-3f  and  A-3g,  a  small  bias  error  remains  for  the  rest  of  the 
interval.  This  is  due  to  the  parameters  lying  between  dis¬ 
cretized  parameter  points;  there  is  no  elemental  filter  in  the 
sliding  bank  which  matches  exactly  the  true  parameter  point. 

In  Figure  A-3h,  the  parameter  undergoes  a  jump  change  at  four 
seconds.  In  Figure  A-3i,  the  parameter  varies  linearly  from 
(£,  <u)  =  (0.07,  9.0)  to  (Q.93 , , 41 .0) .  In  this  case,  ,the  slid¬ 
ing  bank  always  lags  behind  the  true  parameter  resulting  In 
bias-  errors  over  the  entire  interval. 

In  all  cases  the  sliding' bank  estimator  had  little  dif¬ 
ficulty  in  identifying  the  natural  frequency  parameter,  but  had 
significant  difficulty  in  identifying  the  damping  ratio  para¬ 
meter.  A  heuristic  explanation  for  this  can  be  found  through 
consideration  of  a  power  spectral  density  plot  of  the  output 
of  a  second  order  system  driven  by  white  noise  (see  Figure  V-3) 
As  the  natural  frequency  of  the  system  varies,  the  break 
frequency  will  shift,  which  is  easy  to  identify,  v/hen  the 


Figure  V-3.  power  Spectral  Density  of  2 nc*  Order  System 

damping  ratio  shifts,  however,  only  the  peak  of  the  spectral 
curve  will  shift,  and,  when  only  noise  corrupted  measurements 
of  the  position  type  state  are  available,  this  shift  is  muc,h 
harder  to  identify. 

A  more  rigorous  approach  was  taken  to  explain  this 
further.  'An  ambiguity  function  analysis  was  performed  for 
each  of  the  true  parameter  points'  exercised  in  the  simulation. 
(For  a  detailed  discussion  of  the  ambiguity  function  analysis, 
see  Appendix  D.)  Evaluation  of  the  ambiguity  function  comes 
from  an  indication ■ of  the  sensitivity  of  a  single  Kalman 
filter  based  on  a  particular  parameter  value  to  changes  in  the 
true  system  parameters.  This  function  provides  insights  to 
system  identifiability  with  adaptive  estimators.  Sharp  cur¬ 
vature  of  the  ambiguity  function  means  that  system  identifi¬ 
cation  will  be  relatively  easy  and  precise.  Flat  curvature, 
•or  multiple  peaks  of  the  ambiguity  function  mean  that  system 
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identification  will  be  more  difficult. 

Ambiguity  function  plots  for  each  of  the  true  system 
parameters  exercised  in  the  simulation  can  be  found  in  Appendix 
D  (Figures  D-1  through  D-7).  In  all  of  these  plots,  there  is 
a.  sharper  curvature  in  the  oi  direction  than  in  the  C  direction. 
From  these  plots,  one  would  expect  an  adaptive  estimator  to 
have  less  difficulty  identifying  the  natural  frequency  para¬ 
meter  but  greater  difficulty  identifying  the  damping,  ratio 
parameter.  This  is  borne  out  by  the  results  seen  in  the 
simulation. 

In  Figures  A-4a  through  A-4i,  the  true'  system  was  driven 
by  the  noise  signal  plus  the  dither  signal  as  used  in  Figures 
A-3a  through. A-3i;  however,  a  warm-up  of  elemental  filters 
before  moving  was  performed.  In  all  cases,  the  warm-up  only 
slightly  improved  performance.  The  peaks  in  the  variances  of 
the  errors  were  only  slightly  reduced  during  acquisition  (com¬ 
pare  Figure  A-4a  with  A-3a),  not  enough  to  warrant  the  addi¬ 
tional  computation  time  required  to  warm  up  elemental  filters 
before  moving. 

V.2.3,4  Parameter  Position  Estimate  Monitoring.  Figures 
A-5a  through  A-5i  are  graphs  of  the  state  estimate  errors  of 
the. sliding  bank  using  parameter  position  estimate  monitoring, 
with  the  true  system  driven  by  the  noise  signal  alone.  Figures 
A-6a  through  A-6i  are  plots  of  the  state  estimate  errors  with 
the  true  system  driven  by  .the  noise  plus  dither  signal.  In. 
Figures  A-6a  through  A-6c,  the  true  parameters  are  identified 
in  under  1.0  second  arid  from  1.0  to  8.0  seconds,  the  graphs 
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compare  identically  with  the  benchmarks,  Figures  A-la  through 
A-lc.  In  Figure  A-6d,  the  acquisition  time  is  slower;  the  para¬ 
meters  are  identified  by  2.5  seconds.  In  Figure  A-6e,  the  para¬ 
meters  are  not  identified  until  4.0  seconds.  In  Figures  A-6f 
and  A-6g,  the  parameters  are  identified  as  nearly  as  is  pos¬ 
sible  in  1.0  and  2.0  seconds  respectively.  Figure  A-6h  rep¬ 
resents  a  jump  in  parameters  and  A-6i  represents  varying  para¬ 
meters.  .  ( 

In  all  but  the  varying  parameter  case,  the  true  parameter 
was  eventually  identified.  In  some  instances,  the  acquisition 
took  much  longer,  but  this  again  is  explained  by  the  ambiguity 
function  analysis  (recall  Appendix  D). 

Figures  A-7a  through  A-7i  depict  estimation  errors  of  the 
sliding  bank  using  parameter  position  estimate  monitoring  with 
filter  warm-up,  with  the  real  world  model  driven  by  the  noise 
plus  dither.  There  is  no  detectable  improvement  in  perfor¬ 
mance  over  the  no  warm-up  case  (Figures  A-6a  through  A-6i). 

Upon  examination  of  the  results  from  a  single  run  of  the  sim¬ 
ulation,  it  was  found  that  the  estimator  would'  sometimes 
decide  to  move;  at  other  times,  it  would  warm  up  the  wrong 
filters,  and  at  other  times  it  would  switch  back  and  forth  be¬ 
tween  several  warm-up  directions.1  V/ hen  any  of  these  events 
occurred,  the  effect  was  equivalent  to  not  warming  up  any 
filters  at  all.  ■  Cn  the  rare  instances  that  the  proper  filters 
did  warm  up,  the  state  estimates  differed  only  in  the  third 
decimal  place.  As  was  true  with  residual  monitoring,  filter 
warm-up  does  not  offer  a  performance  advantage  to  warrant  the 
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additional  computation  time. 


V.2.4.  Parameter  Position  and  Velocity  Estimate  Moni¬ 
toring.  Figures  A-8a  through  A-8i  are  the  plots  of  the  state 
estimate  errors  of  the  sliding  bnak  using  parameter  position 
and  velocity  estimate  monitoring,  with  the  true  system  driven 
by  the  noise  signal  alone.  As  with  the  previous  sections, 
there  is  virtually  no  difference  between  these  graphs  and  the 
benchmark  graphs,  with  the  exception  of  Figure  A-8a.  In  Figure 
A-8a,  therQ  is  a  slight  increase  in  the  variance  of  the  error 
in  the  velocity- type  variable  near  4.0  seconds. 

In  F  ;ures  A-9a  through  A-9i,  the  true  system  is  driven 
by  the  noise  signal  plus  the  dither  signal.  The  performance 
is  roughly  equivalent  to  that  of  parameter  position  estimate, 
monitoring;  however,  there  is  an  increased  tendency  for  the 
bank  to  wander  away  from  the  true  parameter  position,  as  in 
Figures  A-9a,  A-9c,  A-9d,  and  especially  A-9f. 

Figures  A-IGa  through  A-IOi  are  graphs  of  the  state 
estimate  errors  for  position  and  velocity  estimate  monitoring 
with  the  true  system  driven  by  the  noise  signal  plus  the  dither 
signal  and  with  filter  warm-up  being  used  before  moving  -the 
bank.  Again  there  is  no  appreciable  difference  between  the 
warm-up  and  no  warm-up  cases.  V/ith  a  slight  reduction  of  the 
threshold  to  allow  for  warm-up,  the  bank  exhibits  oscillatory 
characteristics  and  consistently  warms  up  the  wrong  filters  or 
continually  changes  the  filters  being  warmed,  up,  having  the 
effect  of  not  warming  up  any  filters  at  all.  -.If  the  warm-up 
threshold  is  increased  to  a  level  where  the  oscillations  are 


no  longer  present,  the  warm-up  threshold  will  be  so  near'  the 
move  threshold  that  a  decision  .to  warm  up  filters  will  be 
made  concurrently  with  a  move  decision. 

V.2.5.  Probability  Monitoring.  '  Figures  A-11a  through 
A-lli  depict  the  state  estimate  errors  of  the  estimator  using 
probability  monitoring  with  the  true  system  driven  by  the. noise 
signal  alone.  Figures  A-12a  through  A-12i  are  the  error  plots 
for  the  true  system  driven  by  the  noise  signal  plus  the  dither 
signal.  In  Figure  A-12a,  the  system  parameters  are  identified 
in  approximately  0.5  second.  There  is  a  slight  increase  in 
the  variance  just  before  2.0  seconds  due  to  an  excursion  of  the 
bank  from  the  true  parameter  point,  but  recovery  is  quite  rapid 
and  the  bank  remains  .locked  on  the  true  parameter  value  for 
the  remainder  of  the  8.0  second  run.  In  Figure  A-I2b,  the  true 
parameters  are  identified  in  approximately  0.75  second.  In 
Figures  A-12c  and  A-I2d,  the  parameters  are  again,  identified 
in  under  1.0  second.  In  Figure  A-12e,  the  parameters  are  not 
identified  until  sometime  between  5.0  and  4.0  seconds  and 
again  the  flat  curvature  of  the  ambiguity  function  explains 
the  difficulty  in  identification  for  this •  particular  true  para¬ 
meter  point.  V/hen  the  true  parameter  point  lies  between  dis¬ 
cretized  values,  as  in  Figures  A-1 2 f  and  A-I2g,  the  true  para¬ 
meters  are  identified  as  nearly  as  is  possible  in  less  than 
5.0  seconds.  .  Figures  A-12h  and  A-12i  are  graphs  of  the  esti¬ 
mation  errors  for  a  jump  in  true  parameter  value  and  varying 
parameters,  respectively. 

As  was  seeh  previously,  there  is  no  performance  gain 


when  filter  warm-up  is  used.  Figures  A-1 3a  through  A-1 31  are 
the  plots  of  estimation  errors  with  the  true  system  driven 
by  the  dither  signal  plus  the  noise  signal,  using  filter  warm¬ 
up.  Here,  because  the  move  threshold  is  so  low,  the  decision 
to  warm  up  any  filters  is  made  at  the  same  time  a  move  decision 
is  made  and  no  time  is  available  to  warm  up  any  filters. 

V.2.6.  Covariance  Monitoring.  The  covariance  monitoring 
acquisition  cycle  was  used  in  conjunction  with  the  probability 
monitoring  move  decision  method.  Probability  monitoring  was 
chosen  as  it  offered  the  best  overall  performance  of  any  of 
the  other  decision  methods  (this  conclusion  will  be  explained 
in  Section  V.2.7).  Throughout  the  acquisition  period  (when 
the  bank  is  expanded)  the  bank  still  is  given  the  option  of 
moving;  however,  priority  is  given  to,  bank  contraction  in  the 
decision  logic,  as  performance  is  degraded  while  the  bank  is 
expanded  (recall  expansion  decision  via  'residual  monitoring 
discussion). 

Figures  A-1 4a  through  A-14i  depict  the  case  of  the  truth 
model  driven  by  the  noise  signal  alone.  Figures'  A-1 5a  through 
A-15i  are  plots  of  the  estimation  errors  when  the  true  system 
was  driven  by  the  noise  signal  plu3  the  dither  signal.  Per¬ 
formance  was  signif  cantly.  degraded  in  Figure  A-1 5a  over  that 
achieved  in  Figure  A-I2a  for  probability ' monitoring  alone. 

'..'hat  happened  in  this  case  was  that  the  bank  contracts  to  the 
wrong  quadrant  when  going  from  the  initial  to  intermediate 
discretization.  Fven  though  the  bank  could  still  move  through 
the  parameter  space  while  am  the  intermediate  discretization,  ' 


it,  would  typically  contract  again  to  the  finest  discretization 
before  moving.  The  bank  was  then  left  in  no  better  position  ■ 
than  it  would  have  been  at  the  beginning  of  a  run  where  the  co-  • 
variance  monitoring  acquisition  cycle  was  not  used.  This  same 
degradation  in  performance,  although  not  quite  as  severe,  can' 
also  be  found  in  Figures  A-I5c,  A-I5d,  A-15f»  and  A-15i. 

Therq  is  a  performance  improvement  with  the  covariance 
monitoring  acquisition  cycle,  however,  with  Figures  A-15b,  A- 
15e,  and  A-15g.  In  these  cases,  the  bank  quickly  contracted 
to  the  proper  quadrants,  leaving  the  contracted  bank  in  the 
proper  region  of  the  parameter  space  relative  to  the  true  para¬ 
meter  point.  This  occurred  more  rapidly  than  simply  allowing 
a  contracted  bank  to  move  itself  from  the  center  of  the.  para¬ 
meter  space  to  the  proper  position  in  the  parameter  space,  as 
in  Figures  A-12b,  A-I2e,  and  A-12g.  In  Figure  A-15h,  the  per¬ 
formance  was  degraded  during  the  first  4.0  seconds  of  the  run, 
but  was  improved  over  the  non-acquisition  cycle  case  (Figure 
A-12h)  during  the  last  4.0  seconds,  of  the  run;.  V/hen  the  para¬ 
meters  underwent  a  .jump  in  value  at  4.0  seconds,  the  residuals 
grew  quite  large,  causing  the  bank  to  expand.  This  second 
acquisition  cycle  for  the  new  parameter  values  resulted  in  a 
performance'  improvement. 

Figures  A»l6a  through  A-l6i  represent  the  case  of  the 
truth  model  driven  by  the  noise  signal  plu3  the  dither  signal 
with  filter  warm-up.  There  is  .no  difference  in  performance 
between  filter  warm-up  and  no  warm-up.  Again,  raising  the 
threshold  to  allow  for  warm-up  meant  that  the  wrong  filters 
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would  be  warmed  up  or,  when  the  correct  filters  were  warmed  up, 
no  significant  improvement  in  the  performance  was  achieved. 

Finding  the  exact  covariance  monitoring  threshold  settings 
that  would  improve  performance  rather  than  degrade'  it,  for  all 
of  the  possible  true  parameter  positions  (if  possible),  was 
not  accomplished  in  the  limited  time  available  for  this  effort. 
It  is  noted  that  the  covariance  monitoring  acquisition  cycle 
results  in  improved  performance  when  the  true  natural  fre¬ 
quency  is  high  (Figures  A-15b,  A-15e,  and  A-I5g,  where  the 
natural  frequency  is  48.65,  62.83,  and  41.0  rad/sec  respec¬ 
tively).  When  the  true  natural  frequency  is  low  (Figures  A-1 5a, 
A-1 5c ,  A-1 5d ,  and  A-1 5f ,  where  the  natural  frequency  is  10.48, 
13.54,  8.12,  and  9.0  rad/sec  respectively),  the  bank  fails  to 
contract  to  the  proper  quadrant.  In  view  of  this,  alternate 
expand /contract  decision  methods  warrant  investigation.  Fur¬ 
thermore,  in  light  of  the  ambiguity  function  analysis  that 
revealed  different  precisions  in  estimating  £  and  o  as  a  fun¬ 
damental  aspect  of  this  problem,  perhaps  a  weighted  norm  of 
the  two- by- two.  covariance  matrix  would)  offer  improved  charac¬ 
teristics  for  threshold  evaluations. 

V.2.7.  Comparisons.  The  comparisons  in  this  section 
are  based  on  a  qualitative  analysis  of  the  figures  in  Appendix 
A.  Acquisition  times  are  evaluated  by  comparing  each  of  the 
sliding  bank  estimation  error  figures  with  the  benchmark  fig¬ 
ures  (A-la  through  A-1g).  When  the  sliding  bank  estimation 
error  figure  matches  the  single  Kalman  filter  estimation  error 
figure  to  four'  significant  figures,  that  time  is  picked  as  the 
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acquisition  time.  In  some  cases,  several  of  the  move  decision 
methods  had  the  same  acquisition  times,  but  variances  and  bias 
errors  were  different  before  acquisition.  The  decision  methods 
that  exhibited  the  lowest  variance  and  lowest  bias  errors  were 
deemed  "best"  in  these  instances.  In  this  section,  the  only 
figures  compared  are  those  in  which  the  true  system  is  driven 
by  the  noise  plus  dither  signal  with  no  filter  warm-up. 

V . 2 . 7 . 1 .  True  Parameter  Point  «  (£,  <u)  =  (0.0, 

1 C.43) .  Here,  the  residual  monitoring  decision  mode  had  an 
acquisition  time  of  1.0  second.  Rather  large  biases  and  var¬ 
iances  relative  to  the  other  decision  modes  were  exhibited 
prior  to  1.0  second.  (Compare  Figure  A-3a  with  A-6a;  bias 
errors  are  four  times  as  large  and  the  variance  is  fifteen 
times  as  large.)  The  parameter  position  estimate  monitoring 
method  acquired' the  parameter  in  0.56  second  with  the  smallest 
variance  and  bias  errors.  Parameter  position  and  velocity 
monitoring  had  an  acquisition  time  of  0.84  second,  but  had 
larger  variances:  five  times  as  large  as  parameter  position 
estimate  monitoring  (compare  Figure  A'-9a  with  A-6a).  Addition¬ 
ally,  with  parameter  position1 and  velocity  estimate  monitoring, 
the  bank  made  three  excursions  from  the  true  parameter  point 
after  acquisition  (total  time  away:  0.47  second),  causing  the 
variance  to  increase  to  four  times  its  'steady  state  value. 
Probability  monitoring  had,  by  a  slim  margin,  the  quickest 
acquisition  time  of  C.53  second,  but  made  .one  0.13'  second  ex¬ 
cursion  from  tho  true  parameter  point,  probability  'monitoring 
with,  the  covariance  monitoring  acquisition  cycle  had  the  slow- 


est  acquisition  time  of  1 .06  seconds  and  had  variance  and  bias 
errors  that  were  25  ana  12  times  larger,  respectively,  than 
parameter  position  estimate  monitoring  (compare  Figure  A-15a 
with  Ar-6a).  .The  best  performer  for  this  particular ’  parames  er 
point  was  parameter  position  estimate  monitoring. 

V.2.7.2.  True  Parameter  Point  =  (0.1111,  48.65). 

For  this  true  parameter  point,  all  of  the  decision  methods 
performed  equally,  acquiring  the  parameters  in  1.06  seconds, 
with  the  exception  of  probability  monitoring  with  the  covariance 
monitoring  acquisition  cycle.  Probability  and  covariance  moni¬ 
toring  had  a  slight  improvement  in  performance  over  the  other 
methods;  acquisition  time  was  less  (0.63  second)  and  the  ini¬ 
tial  bias  errors  were  only  1/2  as  large  (compare  Figure  A-15b 
with  A-12b,  for  example). 

V.2.7.3.  True  Parameter  Point  =  (C.4444,  13.54). 

In  this  case,  residual  monitoring  and  parameter  position  es¬ 
timate  monitoring  performed  quite  well.  They  each  had  an  ac-- 
auisition  tine'  of  0.09  second  with  very  slight  bias  errors 
(see  Figures  A-3c  and  A-6c).  Parameter  position  and  velocity 
estimate  monitoring  performed  similarly;  acquisition  time  was 
0.13  second,  but  the  peak  variance  wao  three  times  larger  than 
its  steady  state  value  (compare  Figure  A-9c  with  A-3c  and  A-6c). 
Probability  monitoring  had  a  longer  acquisition  time  of  0.47 
second  but  the  bias  error  was  the  smallest  of  any  of  the 
methods:  1/2  as  large  ua  residual  monitoring,  for  example 
(compare  Figure  A-12c  with  A-3c),  The  covariance  monitoring 
acquisition  cycle  had  the  worsx  performance.  The  acquisition  . 


82 


time  for  covariance  monitoring  was  1 .25  seconds  and  the  bias 
errors  were  twice  as  large  as  with  the  other  methods  (compare 
Figures  A-I5c  and  A-3c). 

V.2.7.4.  True  Parameter  Point  =  (C.3689,  8.12). 

At  this  true  parameter  point,  res  ual  monitoring  did  quite 
poorly.  Acquisition  time  v;as  5.2;  seconds  with  a  peak  variance 
six  times  as  large  as  for  probability  monitoring  and  with  per¬ 
sistent  bias  errors  as  large  as  five  times  the  maximum  bias 
error  committed  by  probability  monitoring  (compare  Figure  A-3d 
with  A-I2d).  Parameter  position  estimate  monitoring  showed 
better  performance  with  an  acquisition  time  of  2.65  seconds  and 
bias  errors  only  twice  as  great  as  probability  monitoring  (com¬ 
pare  Figures  A-6d  and  A-12d).  Parameter' position  and  velocity 
estimate  monitoring  had  the  fastest  acquisition  time  of  0.83 
second  but  had  two  instances  where  the  bank  drifted  away  from 
the  true'  parameter  point  (total  time  away:  0.31  second).  Pro¬ 
bability  monitoring  had  the  next  fastest  acquisition  time  of 
1.25  seconds.  Covariance  monitoring  had  an  acquisition  time 
of  3.25  seconds.  The  best  performer  in  this  case  was  proba¬ 
bility  monitoring. 

V.2.7.5.  True  Parameter  Point  ='(1.0,  62^83). 


Residual  monitoring  failed  altogether  irj- its  attempt  to  iden¬ 
tify  the  true  parameter  point.  Parameter  position 'estimate , 
parameter  position  and  velocity  estimate,  and  probability  moni¬ 
toring  all  performed  equally,  with  an  acquisition  time  of  3.63 
seconds.  Covariance  monitoring  showed  the  most  promise,  with 
an  acquisition  time  of  2.25  seconds  and  initial  biases  only  1/2 
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as  large  as  the  other  methods.  (Compare  Figures  A-3e,.  A-oe, 
A-9e,  A-12e,  and  A-15e.) 

V.2.7.6.  True  Parameter  Point  =  (0.C7,  9.0) « 

I'.one  of  the  various  decision  modes  completely  identified  the 
true  parameters.  All  but  parameter , position  and  velocity  es¬ 
timate  monitoring  identified  the  parameters  as  nearly  as  was 
possible  in  1.38  seconds.  Parameter  position  and  velocity 
estimate  monitoring  failed  to  identify  the  parameters;  the 
variance  remained  consistently  on  the  order  of  five  .times 
greater  than  for  probability  monitoring  (compare  Figure  A-9f 
with  A-12f).  Residual  monitoring  and  the  covariance  monitor¬ 
ing  acquisition  cycle  had  larger  variances  and  bias  errors 
(eight  and  three  times  larger,  respectively)  than  parameter 
position  and  probability  monitoring  (compare  Figures  A-3f 
and'  A-15f  with  A-of  or  A-T2f ) .  Parameter  position  estimate 
monitoring  and  probability  monitoring  tied  for  the  best  per¬ 
formance  when  the  true  parameter  point  was  (0.07,  9.0). 

V.2.7.7.  True  Parameter  Point  »  (0.93,  41. 0) . 

For  this  true  parameter  point  position,  residual  monitoring 
failed  to  identify  the  parameters.  Parameter ’position  estimate 
monitoring  identified  the  parameters  in  3.63  seconds.  Para¬ 
meter  position  and  velocity  estimate  monitoring  took  slightly 
longer:  3.33  seconds.  Probability  monitoring  with  the  co- ’ 
variance  monitoring  acquisition  cycle  did  far  better  than  any' 
of  the  other  methods  with  an  acquisition  time  of  0.25  second. 

7.2.7.S.  Jump  and  Varying  Parameters.  For  the 
case  of  jump  parameters,  each  of. the  methods . performed  as  they 
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did  in  Section  7.2  T.b  for  tne  first  4.0  seconds  and  for  the 
last  4.0  seconds  they  performed  as  they  did  in  Section  7.2. 7. 7. 
..hen  the  parame ters  varied,  performance  for  the  first  few 
seconds  was  the  same  as  that  of  decti'on  7. 2. 7. 6,  as  the  true 
parameters  had  not  had  enough  time  to  shift  significantly  away 
from  the  starting  position  of  (C.G7,  rjf.O)  curing  acquisition. 
A:1  of  the  methous  lagged  behind  the  true  parameter  position 
as  it  varied  from  (C..'7,  9.0)  to  (0.93,  41.0)  over  the  ft.O 
second  run.  It  was  anticipated  that  parameter  position  and 
velocity  estimate  monitoring  would  out-perform  the  other 
methods  when  the  true  parameters  varied,  by  anticipating  the 
parameter  movement;  however,  this  method  actually  fared  no 
netter  than  any  of  the  others. 

V.2.7.9.  .'omparison  .'.urorr.ary .  'fable  7-3  summarizes 
the  various  method’s  performances.  The  best  overall  perfor¬ 
mance  of  any  of  t.v  methods  v/an  achieved  by  both  uirameter 
sition  estimate  monitoring  and  by  probability  monitoring. 

•  n  one  case,  parame ter  estimate  monitoring  attained, a  faster 
.acquisition  time  (..ection  7. 2. 7. 2.)  but,  in  another ■ case,  pro- 
t.aoility  monitorinr  was  faster  (woction  '.'.2.7.4),  iesidaal 

•  ■i.itoring  cons_:?t»-ntiy  tor-K  I  oncer  to  t  n  the  trio*  par  i- 

tersi,  and  in  two  .•a..i;s  it  failed  ci:.;  I .  t<>  i  y .  to  iaentify  the 

j.  trimeters.  larametor  position  and  voio<-itv  estimate  moni¬ 
toring  had  no  faster,  aeeuist  Lori  time  than  ii;  parameter 
position  estimate  mori  i  tor  inr  and  exnihitoi  the  additional 
unuesiraDle  characteristic  of  ’'Inning  iocs"  once  the  para¬ 
meters  were  identified,  ".’he  covariance  monitoring  acquisition 


TABLE  V-3 

Acquisition  Times  (sec) 


Parameter 


1.00  1.C6 
C.56  1 .Co 
0.85"  1.C6 
0.53*  1.06 
1.06*  0.63 


lost  lock 


0.09  5.25 

0.09  2.63' 

0.13*  0.88* 
0.47  1.25 

1.25 


—  s  fa .led  to  identify 


6  7 

.38 

— 

.33 

3.63 

3.88 

.38 

3.63 

.38 

0.25, 

parameter 

(0.0,  10.48) 
to. Ill  1 ,  48.65) 
(0.4444,  13.54) 
(0.8889,  '3.1') 
(1.0,  61.53)' 
(0.07,  5.0) 
(0.93,  41. C) 


mode 

residual  moni¬ 
toring 

parameter  position 
estimate  monitor¬ 
ing 

parameter  position 
and  velocity 
estimate  monitor¬ 
ing 

probability 

monitoring 

probability  moni¬ 
toring  with  co- 
variance  monitor¬ 
ing  acquisition 
cycle 


cycle  'performed  quite  well  in  some  instances  (high  true  natural 
frequency)  but  failed  in  others  (low  true  natural  frequency). 

Por  all  of  the  various  decision  methods,  filter  warm-up 
was  found  to  have  little,  if  any,  effect  on  performance.  In 
view  of  this  and  the  additional  computation  time  and  elemental 
filters  needed,  filter  warm-up  is  not  warranted. 

Some  of  the-  similarities  and  differences  in- performance 
of  the  various  decision  -methods  can  be  explained  through  exami¬ 
nation  of  the  values  that  are  compared  against  the ' thresholds . 
'.vith  residual  monitoring,  the  likelihood  quotients  are  used. 
These  are  a  function  of  the  single  most  recent  measurement.  Both 
parameter  position  estimate  and  probability  monitoring,  on  the 
other  hand,  use  functions  of  the  recursive  probability  cal¬ 
culations,  which  are  based  on  all  past  measurements.  Para¬ 
meter  position  and  velocity  estimate  monitoring  performs  in  a 
similar  but  degraded  manner,  degraded  by  the  introduction  cf 
a  pseudorate  of  the  parameter  movement  into  the  calculations 
(in  an  attempt  to  predict  future  characteristics  based  on  trends 
observed  in  the  past). 

7,3.  Controller  Performance- 

Three  types  of  controllers  are  discussed  in  this  section. 
Probability  monitoring  is  the  decision  method  used  to  move 
the  sliding  bank  estimator  (estimator/controller  in  the  case 
of  the  sliding  bank  multiple  model  adaptive  controller)  be¬ 
cause,  as  wa3  discussed  in  the  previous  section,  it  has  the 
best  overall  performance  (along  with  parameter  position  esti¬ 
mate  monitoring,  but  with  the  additional  benefit  of -a  slightly 


less  costly  decision  algorithm  from  a  computational  loading 
standpoint).  In  all  cases,  the  control  was  disabled  for  the 
first  second  of  the  run.  This  was  necessary  to  maintain  stable 
operation  of  the  system  while  the  estimator  attempted  to  iden¬ 
tify  the  true  system  parameters.  If  the  control  is  applied 
before  the  parameters  have  been  identified  (especially  the  <j 
parameter),  the  wrong  control  is  applied,  driving  the  system 
unstable.  The  choice  of  1.0  second  was  made  through  an  exami¬ 
nation  of  parameter  estimation  errors;  the  to  parameter  is  al¬ 
ways  identified  by  1.0  second. 

The  control  cost  weightings  (necessary  for  Squation  III- 
2)  used  were: 

1G5  0 

0 .  10 

These  values  were  picked  to  show  a  dramatic  impact  of  the  con¬ 
trol  on  the  position  type  variable,  assuming  that  tight  control 
of  the  position  type  variable  is  desired.  The  relative  mag¬ 
nitudes  of  the  7/  and  '■:!  terms  place  a  heavy  cost  on  de- 

X11  x22 

viations  of  the  position  type  variable  from  zero,  while  little  ■ 
cost  is  placed  on  deviations  of  the  velocity  type  variable  from 
zero.  In  other  words,,  very  tight  control  is  desired' on  the 
position  type  variable,  with  less  emphasis  on  the  velocity  type 
variable’s  deviations' from  zero.  The  very  low  value  of  the  w 
co3t  weighting  means  that  the  amount  of  control  energy  expended 
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to  regulate  the  states  is  of  little  concern. 

Figures  A-1 7a  through  A-1 7g  are  plots  of  the  two  states  , 
of  the  system  using  a  single  Kalman  filter  and  LQ  controller 
that  have  artificial  knowledge  of  the  parameters.  These  figures 
are  the  benchmark  figures  to  which  the  various  controllers 
are  compared.  (Again,  due:  to  computational  resource  limits, 
there  are  no  benchmark  figures  for  jump  and  varying  parameters.) 

V.3.1 .  single  dhangeable-flain  Controller.  This  control¬ 
ler  structure  is  described  in  Section  III. 3.  Figures  A-1 8a 
through  A-18i  are  graphs  of  the  system  states,  using  the  slid¬ 
ing  bank  estimator  to  provide  estimates  of  the  system  states 
to  a  single  changeable-gain  controller,  the  gain  changed  by 
the  sliding  hank  ert i mator * s  estimate  of  the  true  system  para-  , 
meters.  In  comparing  figures  A-1 7a  through  A-17g  with  Figures 
A-1 8a  through  A-18g,  there  in  no  discernible  difference  be¬ 
tween  the  benchmark  performance  and  that  of  the  adaptive  esti- 
mator/controller  of  this  section,  for  any  of  the  true  para¬ 
meter  positions  used. 

Figure  A-1Sh  is  a  plot  of  the  system  states  for  the  case 
of  the  true  parameters  undergoing  a  jump  in  value  at  4.6, sec¬ 
onds.  The  control  was  disabled  for  1  .o  'second  after  the  jump  . 
■occurred  to  enable  the  estimator  to  identify  the  new  parameter 
values.  If  the  control  had  been  loft  on,  the  controller  would 
ha/c  continued  to  apply  the  control  based  on  the  previous  values 
of  the  parameters,  rose  !  t  i  iv  iri  unr.1  iHc  'x-hav  i  •-  r-.  The  decision 
to  turn  off  the  control  w.s;  -mule  by  residual  monitorinr  .( ...ac¬ 
tion  IT. 4. 1.1),  with  u  threshold  value  of  •k'j.O.  (  value  of 
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15.0  turned  off  the  control  at  2.5 .seconds,  before  the  para¬ 
meters  had  even  jumped  while  a  value  of  55.0  allowed  the  im¬ 
proper  control  to  be  applied  for  5-6  sample  periods  after  the 
parameters  had  jumped  before  turning  off  the  control.)  When 
the  smallest  of  the  likelihood  quotients  (Equation  11-10) 
exceeded  25.0,  the  control  was  disabled  for  1.0  second  (the 
same  time  as  used  for  the  initial  acquisition).  An  attempt  was 
made  to  disable  the  control  only  while  the  threshold  level  was 
exceeded;  however,  erratic  behavior  resulted,  suggesting  that 
a  different  threshold  or  a  different  approach  might  be  needed 
for  deciding  when  to  resume  control.  These  questions  are  topics 
of  further  stud> . 

Figure  A-18i  is  a  plot  of  the  system  states  for  the  case 
of  the  true  parameters  varying.  Here,  the  parameters  varied 
slowly  enough  that  the  proper  control  could  be  applied  through¬ 
out.  Kote  that,  the  two  ends  of  the  plots  compare  closely  with, 
those  of  the  benchmark  figures,  Figures  A-I7f  and  A-I7g. 

7.3.2.  Single  Flxed-C-ain  Controller.  This  controller 
is  a  fixed-gain  controller  that  is. designed  based  upon  a  nomi¬ 
nal  value  of  the  parameters,.  The  controller  is  then  supplied 
with  the  estimated  system  states  from  the  sliding  bank  esti-  ■' 
mator.  (Refer  to  Section  III. 4.)  The  nbrcinal  parameter  value, 
used  for  the  controller  was  (£,  <y)  *  (0.4444,  62.83)  corres¬ 
ponding  to  parameter  space  coordinates  (5,  10),  in  determin- , 
ing  the  nominal  parameter  value ,  it  wa3  found  that  the  con¬ 
troller  had  little  sensitivity  to  variations  in  the  true  { 
parameter.  There  was  a  marked  dependency  of  the  controller.  ■ 


performance  on  the  true  <u  parameter,  however.  V/hen  the  true 
parameter  point  was  in  a  higher  frequency  region  in  the  para¬ 
meter  space  than  that  of  the  nominal  value  used  for  the  con¬ 
troller  design,  the  true-sy stem/estimator/controller  combi¬ 
nation  became  unstable.  For  example,  when  the  nominal  para¬ 
meter  point  chosen  was  (5,  5),  corresponding  to  (C,  o>)  = 
(0.4444,  17.43),  a  true  frequency  of  1S.61  rad/sec  and  above 
resulted  in  unstable  performance.  V/hen  the  true  parameter 
point  was  at  a  lower  frequency  point  than  the  nominal,  the 
system  was  stable  but  performance  was  degraded  over  that  of 
the  benchmark.  In  order  to  maintain  stability  for  all  true 
parameter  values,  the  highest  possible  natural  frequency  value 
was  picked  for  the  nominal  <o  parameter.  Because  of  the  in¬ 
sensitivity,  to  changes  in  the  damping  ratio  parameter,  a  mid 
range  value  was  picked  for  the  £  parameter. 

Figures  A- 19a  through  A-19i  are  plots  of  the  state  vari¬ 
ables  for  the  single  fixed-structure  controller.  In  Figure 
A-1 9a,  the  true  frequency  is  much  lower  than,  the  nominal 
frequency  and  the  performance  is  severely  degraded.  Compare 
Figure  A-1 7a  with,  A-19a;  the  variance  of  the  position  type 
variable  is  roughly  15  times  greater  in  Figure  A-1 9a  than  in 
Figure  A-1 7a.  In' Figure  A-1 9b  the  true  ■  frequency  is  much 
closer  to  the  nominal  frequency  and  as  a  result  the  variance 
of  the  position  type  variable  in  Figure  A-1 9b  is  only  1  1/3 
times  as  great  as  in  Figure  A-1 7b.  In  all  of  the  plots  where 
the  true  frequency  is  high,  performance  is  only  slightly  de-. 
graded  (variances  on  the  order  of  1.5  tines  greater  than  the 
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benchmark).  Compare  Figures  A-1 3e  and,  A-1 9f  with  Figures  A- 
I7e  and  A-17f.  In  the  other  figures  where  the  true  parameter 
point  is  at  the  low  frequency  end  (Figures  A-1 9c  and  A-1 3d),' 
the  degradation  in  performance  is  greater  (variances  on  the 
order  of  6  to  10  times  greater  than  the  benchmark).  Compare 
Figures' A-1 9c  and  A-I9d  with  A-I7c  and  A-17d. 

Figure  A— 1 93a  is  a  plot  of  the  state  variables  for  the 
jump  parameter  case.  Fo  instability  problems  were  encountered 
when  the  parameters  jumped,  as  expected,  since  the  nominal 
parameter  value  was  chosen  such  that  stable  operation  would  be 
achieved  for  any  true  parameter  position.  Performance  during 
the  first  4.0  seconds  is  comparable  to  that  of  Figure  A-19f 
and  performance  during  the  last  4.0  seconds  is  comparable  to 
that  cf  Figure  A-1 9g. 

■  In  Figure  A-1 Si,  the  parameters  are  slowly  varying.  As 
Lae  frequency  is  increased,  the  performance  improves,  as  ex¬ 
pected. 

7.3.3.  ■  Sliding  Bank  Multiple  Model  Adaptive  Controller. 
The  controller  of  this  section  is  made  up  of  nine  elemental 
LOG  controllers  in  which  each  elemental  LQ  controller  is  fed 
state  1  estimates  by  its  corresponding  elemental  filter.  The 
elemental  controller  outputs  are  then  put  through  the  weighted 
average.  (See  Section  III. 5.)  The  performance  of  the  slid¬ 
ing  bank  multiple  model  adaptive  controller  is  identical  to 
that  of  the  single  changeable-gain  controller  and  the  bench¬ 
mark  controllers,  for  all  values  of  the  true  paranr  .ers  exa¬ 
mined.  See  Figures  A-20a  through  A-20i.  The  same  insta¬ 
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bility  problems  encountered  by  the  single  changeable-gain  con¬ 
troller  for  the  ;jump  parameter  case  were  also  encountered  here, 
and  the  remedy  of ,  a  1.0  second  reacquisition  cycle,  initiated 
via  residual  monitoring,  allowed  stable  performance  to  be 
achieved. 

7.3.4.  Comparisons.  Of  the  three  types  of  controllers 
examined,  two  were  identical  in  performance.  The  single  change¬ 
able-gain  controller  and  the  sliding  bank  multiple  model  adap¬ 
tive  controller  both  performed  exceptionally  well,  comparing 
essentially  identically  with  the  benchmark  controllers  (a  single 
Salman  filter  feeding  a  single  LQ  controller,  both  having  ar¬ 
tificial  knowledge  of  the  true  parameters).  The  single  fixed- 
gain  controller  performed  adequately  when  the  true  frequency 
was  high  (with  variances  on  the  order  of  1.5  times  greater  than 
those  of  the  benchmark)  but  did  not  perform  as  well  when  the 
true  frequency  was  low  (with  variances  as  high  as  15  times 
greater  than  these  of  the  benchmark). 

7.4.  ' Computational  Loading 

Multiple  model  adaptive  estimation/control  is  ideally 
suited  for  a  parallel  processing. implementation.  As  a  result, 
discussion  of  computational  loading  is  somewhat  difficult. 
Nevertheless,  an  attempt  is  made  in  this  section  to  evaluate 
computational  loading. 

.  It  is  assumed  that  the  elemental  filters  (filter/con¬ 
trollers  for  the  sliding  bank  multiple  model  adaptive  con¬ 
troller).  would  be  processed  in  a  parallel  fashion  (nine  Xalman- 
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filter-on-a-chip * s ,  for  example).  The  propagations  and  updates 
of  the  state  estimates  of  the  elemental  estimators  and  the 
numerators  of  the  recursive  probability  weightings  (Equation 
II-9)  could  all  be  accomplished  in  a  parallel  fashion.  For 
the  simple  two- state  system  of  this  study,  assuming  steady- 
state-gain  filters,  a  total  of  six  multiplies  and  six  adds 
would  be  needed  to  propagate  an  elemental  state  estimate  from 
one  sample  time  to  the  next  and  to  update  it  with  the  latest 
measurement.  To  calculate  the  numerators  of  the  probability 
weightings,  four  multiplies,  one  square  root,  and  one  exponen¬ 
tiation  would  be  required. 

•The  computations  that  need  to  be  carried  out  in  a  serial 
manner  are  the  denominator  of  the  recursive  probability  weight¬ 
ings  and  the  weighted  averaging  of  the  elemental  .state  estimates 
These  two  calculations  combined  require  a  total  of  19  multiplies 
and  24  adds. 

i 

If  the  feedback  control  calculations  are  also  to  be  con¬ 
ducted  in  serial  (as  for  the  single  changeable-gain  controller 
of  Section  III.3),  a  total  of  12  multiplies  and  20  adds  would 
be  needed  (assuming  the  interpolation  scheme  of  Section  III. 3 
is  used  to  compute  the  steady-state  controller  gains).  If  the' 
fixed-gain  controller  is  used,  only  two  multiplies  ana  one  add 
are  needed  (again,  steady-state  gains  are  assumed).  See  Figure 
7-4. 

I’f  the  feedback  control  is  to  be  calculated  via  the  slid¬ 
ing  bank  multiple  model  adaptive ■ control  method ' (Section  III. 5) , 
it  is  assumed  that  the  elemental  control  calculations  would 
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Figure  V-4.  Single-Gain  Controller  Computational  Burden 


also  be  calculated  in  parallel,  Shis  would  mean  that  an  ad¬ 
ditional  two  multiplies  and  one  add  would  be  calculated  in 
parallel.  The  weighted  averaging  computation  requires  fewer 
operations  with  the  sliding  bank  multiple  model  adaptive  con¬ 
trol  method,  since  only  a  single  scalar  control  variable  needs 
to  be  computed  instead  of  the  two  state  variables  necessary 
for  the  single-gain  (changeable  cr  fixed)  controller  methods. 

The  weighted  averaging,  with  this  approach,  requires  16  adds 
and  10  multiplies.  See  Figure  V-5. 

.  The  only  serial  processing'  item  left  is  the  move-the-bank 
decision  logic.  Assuming  probability  monitoring  is  used  to 
move  the  bank,  10  "if’s”  would  need  to  be  processed  in  order 
to  check  the  probability  weightings  against  the  threshold  and 
to' decide  whether  or  not  to  move,.  If  the  decision  is  made  to 
move,  the  worst  case  would  be  if  five  filters  were  changed  , to 
new  locations  'in  the  parameter  space.  The  reinitialization  of 
five  different  filters  would  require  75  storage  transfers  (to 
change  tne  filters  to  their  new  values  of  4>v,  B,,  ,  P...  +  a, 

K  CIk  K  I  I  k 

x^,  and  pk).  In  addition  to  the  storage  transfers,  22 'multi¬ 
plies,  9  adds,  5, square  roots,  and  5  exponentiations  must  be 
accomplished  to. calculate  the  pk's  for  the  new  filters  (Squa-  ■ 
tion  11-11).  If  the  multiple  model  adaptive  control  is  used, 
an  additional  1C  storage  transfers  would  be  needed  for  the  Ck’s. 

Table  V-4  presents  a  summary  of  the  computation  times 
(keeping  ih  mind  that  these  times  are  for  comparisons  between 
methods  only)  of  the  various  control  schemes,  based  on  rep¬ 
resentative  operation  tines  of  1m  second  for  a  branch,  1m  sec- 
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Figure  V-5.  Sliding  Bank  Multiple  Model  Adaptive  Controller 
Computational  Burden 


all  computations  conducted 
serially 


ond  for  a  storage  transfer,  3f*  seconds  for  an  add,  6/x  seconds 
for  a  multiply,  and  6 On  seconds  for  either  square  roots  or 
exponentiations.  (Recall,  that  the  numbers  of  individual  op¬ 
erations  are  specified  in  figures  7-4  and  7-5 »  if  it  is  de¬ 
sired  to  cailor'this  comparison  to  other  machine  capabilities.) 
for  comparison,  the  full  bank  approach  (ICC  filter/controllers) 
is  presented.  The  full  bank  requires  198  adds  and  1 01  multi¬ 
plies  to  perform  the  weighted  averaging  but  does  not  require 
any  time  for  a  move-the-bahk  decision. 

The  least  amount  of  processing  time  is  required  by  the 
sliding  bank  multiple  model  adaptive  control  scheme  (1.138 
milliseconds).  fext  is  the  single  fixed-gain  controller  with 
1.246  milliseconds  required  processing  time,  finally,  the 
single  gangeable-gain  controller  needs  1.36  milliseconds  for 
execution.  All  three  methods  require  les3  time  than  the  full 
bank  multiple  model  adaptive  controller,  which  requires  1.416 
milliseconds.  If  all  computations  are  to  be  conducted . serially , 
the  three  sliding  bank  multiple  model  adaptive  estimatcr/con- 
troller  schemes  require  very  nearly  the  same  amount  of  com¬ 
putation  time  (2.9,  2.S,  and  2.7  milliseconds).  'The  full  bank 
multiple  model  adaptive  controller,  on  the  other  hand,  requires 
an  order  of  magnitude  increase  in  computation  time  (21  milli¬ 
seconds)  over  the  sliding  bank  schemes.  . 

7.5.  Summary 

The  performances  of  the  various  move  decision  schemes 
for  a  sliding  tank  multiple  model  adaptive  estimator  and  the 
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characteristics  of  throe  controller  schemes  based  on  sliding 
bank  multiple  model  adaptive  estimation  were  presented  in  this 
chapter . 

The  best  overall  move  decision  schemes  were  parameter 
position  estimate  monitoring  and  probability  monitoring.  A 
separate  acquisition  cycle,  using  parameter  covariance  moni¬ 
toring,  offered  a  performance  i mprover.ont  i  ri  some  cases,  but 
degraded  perf ornance  in  others.  Letting  a  fixed  3ize  bank 
"walk"  to  the  true  pa rare ter  point  worked  well  for  all  true 
parameter  conditions,  filter  warm-up  before  moving  did  not 
prove  fruitful;  in  many  cases  there  was  no  detectable  improve¬ 
ment  in  performance  when  filter  warm-up  was  used.  In’ all  of 
Lue  move  decision  rchem.es ,  parameter  acquisition  win  enhanced 
when  either  a  ui trier  sl.pial  was  applied  in  audition  to  a  true 
system  driving  noise  signal,  or  when  fee. i back  control  was  ap- 

P  i  i.ed . 

iTonabj  1  i  ty  t:  on  i  tori  n/ :  won  used  in  •nn.iunet.ion  w  i  th  each 
of  the  three  control  1 er  schemes,  doth  the  single  changeable- 
ain  controller  and  the. sliding  h  ink  aultiplc  :'.o.te  I  adaptive 
controller  performed  exceptionally  well,  congtring  essentially 
identically  with  the  benohwtrK  of  a  single  Kalman  filter/i  -: 
e  nitre  Her  that  liai  artificial  l.nowicl  the  true  system 

p  .  came  turn.  The  sir.  !••  fi  a  d-.,a  in  em,  tru  •  I  «■  r,  bas*>d  on  nomi¬ 
nal  parameter  values  of  a  mia-va  i  uc  %  and  tng  '  u  i  'nest  discrete 
".line  of  <a  under  ooii/.lu  -r  ition  (in  or*a-r  m  .■  ,  rov  i.  ie  stability 
ill  true  j-  .  u  .« ■  to  j  ;  .  !  i  i  .  r  'oi  r-  i  we  :  I  wh  as  the  true  . 
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tr oiler ,  but  exhibited  degraded  performance  when  the  true 
parameter  point  was  far  from  the  nominal  point. 

The  three  controller  schemes  require  roughly  the  same 
amount  of  computation  time.  The  single  changeable-gain  con¬ 
troller  requires  1.36  milliseconds,  the  single  fixed-gain  con¬ 
troller  requires  1.246  milliseconds,  and  the  sliding  bank  mul¬ 
tiple  model  adaptive  controller  requires  1.188  milliseconds. 
All  three  require  less  than  the  full  bank ' multiple  model  adap¬ 
tive  controller,  which  requires  1.416  milliseconds.  If  all 
computations  are  performed  serially,  the  full  bank  multiple 
model  adaptive  controller  requires  21  milliseconds  while  the 
three  sliding  bank  controllers  only  require  2.9,  2.3,  or  2.7 
milliseconds. 
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VI.  1 


Introduction 


The  feasibility  of  a  moving  bank  multiple  model  adap¬ 
tive  estimator/controller  has  been  examined  in  this  thesis. 
Slicing  bank  multiple  model  adaptive  estimation  differs  from 
conventional  full  bank  multiple  model  adaptive  estimation  in 
that  a  substantially  reduced  number  of  elemental  filters  is 
required  for  the  sliding  bank  estimator  (9  elemental  filters 
vs.  ICO  for  the  system  modeled  in  this  thesis).  Reduction  of 
the  number  of  elemental  filters  is  accomplished  through  a  dy¬ 
namic  re-declaration  of  the  positions  in  parameter  space  that 
the  sliding  bank’s  elemental  filters  occupy;  i.  e.,  the  smaller 
number  of  filters  in  the  sliding  bank  are  moved  about  the  para¬ 
meter  space  in  search  of  the  true  parameter  point.  Critical 
to  the  performance  of  the  sliding  bank  estimator  is  the  de¬ 
cision  method  that  governs  movement  of  the  bank  of  elemental 
filters.  Because  of  this,  a  number  of  different  decision 
algorithms  have  been  discussed  and  their  respective  perfor¬ 
mance  compared. 

Three-  controller  designs  have  also  been  examined  in  this 
thesis.  The  first  design  that' has  been  explored  uses  a  single 
controller  fed  by  state  estimates,  with  control  gains  that 
are  calculated  based  on  the  current  parameter  position  esti¬ 
mate,  which  is  provided  by  the  sliding  bank  estimator.  A. 
second  design  that. has  been  examined  consists  of  state 
estimates  being  premultiplied  by  a  single  fixed-gain  con- 


troller  that  is  based  upon  a  single  nominal  parameter  value, 
chosen  so  as  to  provide  robust,  adequate  control  for  all  true 
parameter  values.  Sliding  bank  multiple  model  adaptive  con¬ 
trol  has  been  examined  as  well;  an  elemental  controller  is 
cascaded  with  each  of  the  elemental  filters  of  the  sliding 
bank,  computing  feedback  control  from  a  weighted  average  of 
the  elemental  controller  outputs. 

States  of  a  damped  second  order  system,  with  uncertain 
parameters  (damping  ratio  £  and  undamped  natural  frequency  <w) 
have  been  estimated  by  the  sliding  bank  estimator  and  then 
regulated  to  the  quiescent  state  by  the  controller.  Perfor¬ 
mance  of  the  sliding  bank  estina tor/controller  has  been  com¬ 
pared  to  a  benchmark  of  a  single  Kalman  filter/LQ  controller 
that  has  (artificial)  knowledge  of  the  true  parameter  values. 
Comparisons  have  been  based  upon  Monte  Carlo  analysis  results. 

VI. 2.  Sliding  Bank  Multiple  P^odel  Adaptive  Estimator 

Four  move-the-bank  decision  methods  have  been  examined: 

a.  residual  monitoring 

b.  parameter  position  estimate  monitoring 

c.  parameter  position'  and  velocity  estimate  monitoring 

d.  probability ■ monitoring 

Also  examined  have  been  a  separate  acquisition  cycle  in  which 
the  spacing  of  parameters  to  define  elemental  filters  is  al¬ 
lowed  to  vary,  using  parameter  covariance  monitoring,  and  the 
use  of  "filter  warm-up"  before  moving  the  bank. 

The  best  performing  move-the-bank  decision  methods'  are 


parameter  position  estimate  monitoring  and  probability  moni¬ 
toring.  The  state  estimate  error  plots  of  the  sliding  bank 
estimator  using  these  decision  methods  compare  essentially 
identically  with  those  of  the  benchmark,  once  parameter  ac¬ 
quisition  has  occurred  (acquisition  times  range  from  0.47  to 
3.63  seconds  depending  upon  the  values  of  the  ti’ue  parameters) 
gurameter  position  estimate  monitoring  and  probability  moni¬ 
toring  are  quite  similar  algorithms;  both  are  based  on  the 
recursive  probability  weightings  inherent  in  a  multiple  model 
adaptive  algorithm,  probability  monitoring  is  less  demanding 
computationally,  however. 

The  covariance  monitoring  acquisition  cycle  improves 
performance  when  the  true  system  natural  frequency  is  high, 
but  degrades  performance  when  the  true  natural  frequency  is 
low.  "harming  filters  up"  before  actual  use  within  the  slid¬ 
ing  bank  does  not  significantly  affect  performance.  The 
additional  computation  time  and  complexity  required  to  warm 
up  filters  before  a  move  are  not  warranted. 

•/  f .  3 .  don  troll  er 

The  best-performing  Inove  decision  method,  probability 
monitoring,  has  been  used  for  the  sliding  L.nk  estimator  in 
conjunction  with  each  of  the  controller  scheme::,  ff  the  three 
controller  schemes,  two  perform  in  an  essentially  identical 
manner.  There  is  no  detectable  difference  between  state 
variable  plots '  o,f  the  single  changeable-gain  controller 
and  the  sliding  bank multiple  model  adaptive  controller,  and 
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both  are  indistinguishable  from  state  variable  plots  of  the 
benchmark.  The'  single  fixed-gain  controller  performs  well 
when  the  true  parameters  are  near  the  nominal  parameter  point 
chosen  for  the  controller,  but  it  performs  poorly  when  the 
true  parameters  lie  far  from  the  nominal  parameter  point. 
Additionally,  when  the  true  natural  frequency  is  greater  than 
the  nominal  natural  frequency ,  the  sliding  bank  estimator/ 
fixed-gain  controller  drives  the  system  unstable;  therefore 
a  nominal  natural  frequency  corresponding  to  the  highest  fre¬ 
quency  in  the  parameter  space  is  used  for  the  fixed-gain  con¬ 
troller.  The  performance  degradation  is  not  warranted  by  the 
reduced  computational  loading. 

VI. 4.  Areas  of  Further  Study 

There  are  a  number  of  issues  concerning  the  sliding  ■ 
bank  multiple  model  adaptive  estimator/controller  that  warrant 
further  exploration.  Cne  area  that  deservs  further  attention 
is  performance  sensitivity  to  poor  initial  conditions  and  to 
driving  and  measurement  noise  strengths.  Both  sensitivity  to 
3  and  R,  withrther filter  knowledgable  of  correct  Q  and  a,  and 

t  _  . 

robustness  to  incorrect  Q  and  R  values  should  be  explored. 

Another  area  worth  investigation  is  the  appropriate 
method  of  enabling  control.  Per  the  controller  designs  exam¬ 
ined  in  this  thesis,  the  feedback  control  is  disabled  for  the 
first  second  of  operation  to  allow  the'  sliding  bank  estimator 
to  identify  the  system  parameters  (at  least  the  parameter); 
otherwise  unstable  operation  results.  '  In  light  of  the  fact 


that  the  system  becomes  unstable  when  the  true  frequency  is 
greater  than  the  estimated  frequency  used  to  compute  the  con¬ 
troller  gains,  nominal  control  gains  based  on  the  highest 
possible  frequency  might  be  used  during  parameter  acquisition 
so  that  at  least  some  control  is  applied.  Additionally,  an 
appropriate  method  of  deciding  when  to  enable  control  can  be 
investigated.  Rather  than  just  disabling  control  or  using 
gains  based  on  the  highest  a>  for  one  second  (or  some  other 
fixed  interval  of  time)  to  allow  for  parameter  acquisition, 
a  method  of  deciding  when  parameter  acquisition  has  occurred 
(perhaps  based  on  residual  monitoring)  might  be  developed  so 
that  a  more  rapid  application  of  appropriate  control  can  be 
obtained . 

The  covariance  monitoring  acquisition  cycle  offers  a 
substantial  performance  improvement  when  the  true  natural 
frequency  is  high  but  degrades  performance  when  the  true 
natural  frequency  is  low.  Analysis  of  other  acquisition 
schemes  (perhaps  as  simple  as  comparing  a .weighted  norm  of  the 
parameter  covariance  matrix  to  an  appropriate  threshold  level) 
may  yield  a  method  that  improves  performance  for  all  true' 
parameter  values. 

In  light  of  the  fact  that  filter  warm-up  does  not  im¬ 
prove  performance,  ether  methods  of  contraction  than  ‘’best 
quadrant”  should  also  be  explored .  This  method  was  selected 
oi  the  basis  that  it  would  retain  four  previously  defined 
elemental  filters  through  a  contraction  cycle,  rather  than 
requiring  nine  totally  new  elemental  filters  to  be  initiated. 
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Since  the  higher  number  of  newly  initiated  filters  does  not 
seem  to  degrade  performance  significantly,  .it  may  be  better  to 
center  the  newly-declared,  contracted  bank  on  the  location 
closest  to  the  parameter  estimate  £(t^).  This  and  perhaps 
other  contraction  logics  warrant  further  study. 

Different  parameter  space  discretizations  is  another 
area  deserving  of  consideration.  A  finer  parameter  space  dis¬ 
cretization  may  improve  performance  when  the  true  parameters 
are  between  discretized  values.'  Sliding  bank  multiple  model 
adaptive  estimator/controller  performance  might  also  be  in¬ 
vestigated  for  different  true  systems  (higher  order)  with 
different  uncertain  parameters. 

Performance  of  MAP  (maximum  a  posteriori;  i.  e.,  one 
that  uses  the  "best"  elemental  filter’s  state  or  parameter 
estimate  as  the  overall  state  or  parameter  estimate)  vs.  the 
Bayesian  weighted  average  of  filters  should  also  be  explored. 
This  is  tied  closely  to  appropriate  discretization  of  the  para-, 
meter  space;  MAP  methods  can  be  expected,  to  respond  more  quick¬ 
ly  to  true  changes  in  the  true  parameter  values,  but  suffer 
more  from  coarse  discretizations. 

VI. 5.  Summary 

•This  thesis  demonstrates  that  the  sliding  bank  multiple 
model  adaptive  estimator/controller  is  a- possible  alternative 
to  the  conventional' full  bank  multiple  model  adaptive. estimator/ 
controller.  For  the  two  state  system' of  this  study,  the  slid¬ 
ing  bank  estimator/controller  offers  performance  that  is. 
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essentially  identical  to  that  of  a  single  Zalman  filter/lQ 
controller  that  has  (artificial)  knowledge  of  the  true  para¬ 
meters,  once  parameter  acquisition  has  occurred.  In  addition, 
only  9  elemental  filters  are  needed  for  the  sliding  bank 
estimator  vs.  100  for  the  full  bank  multiple  model  adaptive 
estimator  based  •  on  10  .discrete  values  for 'each  of  two  un¬ 
certain  parameters.  The  advantages  of  the  sliding  bank  con¬ 
cept  become  even  more  striking  as  the  discretization  becomes 
finer  or  the  number  of  uncertain  parameters  increases.  Re¬ 
search  should  continue  in  order  to  develop  this  practical 
adaptive  algorithm  more  fully. 


Appendix  A 


Simulation  Plots 
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Figure  A**l5f.  Parameter  Covariance  Monitoring 
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Appendix  C:  Simulation  Software 
C.1 *  Introduction 

The  simulation  software  created  for  this  thesis  consists 
of  two  main  FORTRAN  V  programs.  The  first  program  (simulation) 
generates  the  data  necessary  for  the  Monte  Carlo  analysis  and 
the  second  program  (post  processor)  reads  that  data,  and  then 
creates  plots  of  the  desired  variables  of  interest. 

C.2.  Simulation 

The.  simulation  program  consists  of  an  executive  routine, 
BANK,  which  calls  a  number  of  subroutines.  The  hierarchy  of 
the  routiries  is  depicted  in  Figure  C-1 . 

C.2.1.  BATIK.  BANK  is  the  executive  routine.  Its  func¬ 
tions  are  data  input,  initialization  of  variables  before  each 
Monte  Carlo  run,  and  data  output  during  each  run.  Figure  C-2 
is  a  flow  chart  of  BANK.  There  are  two  main  loops  in  the  pro¬ 
gram.  The  outer  loop  controls  the  number  of  Monte  Carlo  runs 
while,  the  inner  loop  controls  a  single  run, 

C.2.2.  TRUE.  This  routine  is  called  by  BANK  and  its 
function  is  to  propagate  the  true  system  states  from  one  sam¬ 
ple  time  to  the  next  via  Equation  (II-4).  .  TRUE  calls  two 
other  subroutines,  R V/  and  MTX. 

C.2i2.1.  RN.  Subroutine  R V/  is  the  random  vector 
generator.  It  generates  a  discrete  time  white'  Gaussian  random' 
vector  w^  with  a  mean  of  0  and  a  covariance  of  I. 

C.2.2. 2.  MTX.  This  subroutine  calculates  the 
state  transition,  control  input,  and  noise  input'  matrices  for 
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the  true  system  Bd  ,  and  Gd  ,  respectively)  from  the 

t  t 

current  value  of  the  parameter  vector. 

C.2.3.  PROPGT ..  Subroutine  PROPGT  propagates  the  state 
estimates  of  each  elemental  filter  in  the  bank  from  one  sample 
time  to  the  next.  It  implements  the  equations 

C.2.4.  MBAS.  This  subroutine  takes  a  measurement  of 
the  true  system.  MEAS  also  makes  a  call  to  RW  (Section  C.2. 
2.1)  via  the  equation 

acv  -  xtl<ti)  +  I(y 

The  measurement  is  created  by  adding  the  first  element  of  the 
random  vector  obtained  from  RW  (after  multiplying  by  the  square 
root  of  the  measurement  noise  variance)  to  the  true  system 
position  type  state  variable. 

C.2.5.  RBSII).  This  routine  computes  the  residuals  for 
each  of  the  elemental  filters  of  the  sliding  bank,  i.  e., 

Sr^j)  s  -  ^^i  ) 

C.2.6.  UPSTB.  UPDTB  updates  the  state  estimates  of 
each  elemental  filter  with  the  most  recent  measurement 
according  to 
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£k<li+)  *  iTh")  "  rA(ti> 


ij.<:  .7.  3'kOBl  .  This  routine  calculates  the  recursive 
probability  weightings  p^(t^)  for  each  elemental  inter. 
i  ;OhL  calls  an  additional  subroutine,  P. 

0.2. 7.1.  2.  This  subroutine  computes  the  numer¬ 

ator  terms  of  the  recursive  probability  calculations  (in 
.quation  II-9) . 

0.2.8.  A VO .  subroutine  A VO  computes  the  weighted 
average  of  the  elemental  state  estimates  (Aquation  II-8). 

A VO  also  computes  the  parameter  estimate  and  the  parameter 
'•si. imate  covariance  (Aquations  1-8  and  i-'i). 

0.2.9.  ':;:TKl.  This  subroutine  calculates  the  control 

to  be  applied  to  the  true  system.  '  There  are  five  versions  of 
tais  subroutine  to  allow  for  no  control,  the  dither  signal  of 
notion  V.2,  the  single  changeable-gain  controller  of  Section 
~  r  t.3*  the  single  fixed-gain  controller  of  Section  311.4, 
and  sliding  bank  multiple  model  adaptive  control  (Section 
:  !  1.5). 

d.2.10.  Ag  J  o.  P.j.'.lD  controls  movement  of  the  bank. 

It  calls  jj’IIA’  ,  A  A  all,  ana  HOVa.  After  ha  TO  calls  PTLT,  the 
a.::  Lsi.ea  is  mail  > ;  e  i.  Uior  to  expand  ,  'con  t,  move,  or;  warm  • 
up  filters,  depending  upon  the  threshold  levels.  Tf  it  is 
..eciued  simply  to  warm  up  filters,  only  a  will  be  called 


•<:u  .A;,!)  will  return  to 


f  h o  j* i .!  tors  are  ourren  tly 


*>V-V  A 
'•A-;.-.'; 


•*v.*  •  V 

• _ 


•n.ing  up  and  it  is  decided  to  move  ( or .  e;. i ••  t r.d/ contract )  the 


bank,  WARM  and  KOVb  will  be  called  consecutively.  If  filters 
are  warming  up  and  it  is  decided  to  move,  itOVK  aione  will  be 
called.  If  it  lias  been  decided  not  to  use  filter  warm-up,  set¬ 
ting  the  warm-up  and  the  move  thresholds  to  the  same  value  elim¬ 
inates  the  possibility  of  filter  warm-up  occurring. 

0.2.10.1  .  IT;  *!  .  •'■‘hie  subprogram  returns  both 

a  value  that  is  to  be  compared  to  the  threshold  and  the  move 
direction  associated  with  that  value.  The  value  is  calculated 
according  to  the  decision  method  in  operation  (supplied  by  the 
simulation  program  input  data  file). 

0.2.10.2.  v, ARK .  This  routine  transfers  all  of 
the  appropriate  matrices  to  an  array  of  nine  additional  filters 
to  be  "warmed  up" .  aaeh  filter  is  initialised  with  its  appro¬ 
priate  state  os  cirri:  ..to  arid  probability  weighting. 

•  0'/  ;.  This  routine  transfers  ail  of  the 
.atriccs,  state  estimates,  and  probabi  lity  weightings  from  the 
nine  additional  filters  established  in  ..id;-.  to  the  nine  on 
line  filters. 


'.2.  post'  Processor 

The  post  processor  program  consists  of  a  main  routine 
a  no  one  subroutine.  Tat.  main  program  computes  moans  and 
variances  and  the  subroutine  creates  plots. 

■J.3.1.  '  a T.  'inis  is. .  the  n  sin  ps  rain  .  i  bJ’.T  reads 
a  data  flic  generate  i  b.v  '  !'  and  computes  the  itcum  arid 

V  .  i '  i  ' i <  ■ . :  O  b  the  :  ;  •  i  ■  I  ■  I  i  s  ...  i  n  l,i  t  :  I,,  '  .  i  I  i . .  >  »'ii  l.|in  L: 

the.  u.e  ...>  rum  vari  rices  of  the  variable::  of  interest  to-  a  prin» 


ter  file.  RESLT  makes  one  call  to  subroutine  SI0T8 


C.3.2.  SL0T8.  This  subroutine  generates  a  plot  file 
of  the  means  and  variances  computed  in  RESLT. 

C.4.  Summary 

This  appendix  has  discussed  each  of  the  routines  con¬ 
tained  in  the  simulation  software.  Two  primary  programs  are 
used,  one  for  the  simulation  which  generates  the  necessary 
data  and  one  for  post  processing  which  computes  statistics  of 
the  data  and  generates  plots. 


Appendix  D:  Ambiguity  Function  Analysis  (6:97-99) 

Much  information  about  the  expected  performance  of  an 
adaptive  estimator  can  be  obtained  from  an  ambiguity  function 
analysis.  The  generalized  ambiguity  function  is  given  by 


Ai<£4t>  4  i]  f|(t1)|a(ti)(2i|at>dSi  (0-1) 


where  a  is  the  parameter  vector,  a^  is  the  true  parameter 
vector*  and  iJjitZj  is  a  likelihood  function.  For  a  given 
value  of  a^,  this  function  of  a  yields  information  about  the 
expected  ability  of  the  estimator  to  estimate  parameters.  The 
curvature  of  the  ambiguity  function  at  a^  predicts  the  pre¬ 
cision  with  which  the  adaptive  estimator  can  estimate  the 
parameters:  the  sharper  the  curvature,  the  greater  the  pre¬ 
cision.  This  curvature  is  inversly  related  to  the  Cramer  Rao 
lower  bound  on  the  estimate  error  covariance  matrix  by 
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Global  parameter  space  performance  is  also  obtained  from  the 
ambiguity  function.  If  there  are  multiple  peaks  cf  the  am¬ 
biguity  function,  the  adaptive  estimator  cay  converge  to  in¬ 
correct  parameter  values  corresponding  to  one  of  the  local 
maxima  or  it  may  not  converge  at  all. 

The  ambiguity  function  (Equation  D-1 )  can  be  calculated 


I 

I 


through  the  evaluation  of  covariance  analysis  results  in  which 
the  true  system  is  based  on  and  the  estimator  is  a  single 
Kalman  filter  of  the  same  structure  as  the  true  system,  but 
based  on  a  instead  of  a,.  The  ambiguity  .function  is  given  by 


Ai(a,at)'  = 


wno  re 


)'-  in;  1  n  ( /  rt ,  -  _  ]  n[  | ( t  L  ,a j  ] 

■  -itr{a"i(ti,a)['!(ti)j‘e(ti";at,a}:i?(ti)  +  RC^)]} 

-in  ln(2»r)  -  i  ln[  |i  (ti+,a}|] 

) 

- -tr (ti+,a}i e(t.+;at,a)J  (D-2 ) 

A.(ti,a;  r,  j\(t.  )•,  (t.~,a,:i' ( t;  )  +  of  the 

;  i.  .an  filter  based  on  . 


=  t!io 

oovar  i  r; 

ce  r:.at 

ria  of 

the 

error 

between  the 

state 

or  t.  in. a 

ton  of 

the 

\  a  J  n 

an  filte 

r  h  .u; 

l  on  .a 

a  nd 

th 

r> 

.  '.  I. 

i  •  .,1*  t.h 

■  true 

ha  s 

ed 

on 

v.  ner 

e  j  r 

II  +  II  -t 

•  •note:: 

be  lore 

or 

a  t. 

r  irnvu’i' 

or  a  'io. 

ri  a f  the  i- 

th 

me 

ru  re 

nest. 

••'or 

J  i'  '  ‘J. t  t,  !  i' 

Iru.  t’ii 

1  •  I*.-'-  s’.i o 

. .  . :  a.  i .  • l  '  i 

a  Lai.; 

Laos! 

9 

Slot 

ion  (  b- 

’  /■  !  U 

i  t]  !  '  >  l  •  1 '  « . 

aarviiit! 

ter  vec- 

tor  a 

t  va 

s<; 

t  e-jua  : 

l.i'  i  ,iara  ;-e 

te  r  i ;  , 

or  study 

»»nd 

A!<- 

'±0 

Was 

aba; 

>  i  i  !’or  a  <: 

|ii.  i  !  t  i  n  '  •..••! 

>!’  trie  1 

i  i  i:- 

iiyu 

poili 

its  in  t; 

!*  . i"i!  •  to r 

s ;  >.  <  i  a.- .  ;  r . 

1  l'(  ns  ’Is 

1’e  i'Ua 

ten 

for 

Other  o 

1  '  i;or  . 

■  1  he  ; *  so  i  t.  : 

a.  su.rl'a 

v-*:: 

;  • :  :* : 

r;  tei  i 

i  n 

•'  i 

-  !  t  i rati  •  i 

-7.  ( lot.- : 

arrow.  1  Oi 

:a  t os'  a  ,  . 

I 


ZETfl :  0.000  WN:  10.43 


j'aS*'* 


ZETfl:  O.'OOO  WN:  10.48 


ZETfl:  .1111  NN:  48.65 


336 


Figure  D-3b..  Ambiguity  Function,  at  «  (5,  4.) 
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Figure  D-6b.  Ambiguity  Function,  at  «  (0.07,  9. 
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This  investigation  examines  the  feasibility  of  a  moving  bank  multiple 
model  adaptive  estimation/ocntiol  algorithm.  Sliding  bank  multiple  model 
adaptive  estimation  differs  from  conventional  multiple  model  adaptive  esti- 
.  maticn  in  that  a  substantially  reduced  number  of  elemental  filters  is  required 
for  the  sliding  bank  estimator  {9  elemental  filters  vs.  100  for  the  system 
modeled  in  this  thesis) .  The  positions  in  parameter  space  that  the  reduced 
nuifaer  of  elemental  filters  occupy  are  dynanically  re-declared;  i.  e.,  the  slid¬ 
ing  bank  of  filters  is  moved  about  the  parameter  spaoe  in  search  of  the  trie 
parameter  point. 

Critical  to  the  performance  of  the  sliding  bank  estimator  is  the  decision 
method  that  governs  movement  of  the  bank  of  elemental  filters.  Because  of 
this,  a  number  of  different  decision  algorithms  are  discussed  and  their  re¬ 
spective  performance  compared.  Three  controller  designs  are  also  examined: 
a  single  changeable-gain,  a  single  fixed-gain,  and  a  sliding  bank  multiple 
model  adaptive  controller. 

States  of  a  damped  second  order  system,  with  uncertain  parameters  (damping 
ratio  and  undamped  natural  frequency)  are  estimated  by  the  sliding  bank  esti-, 
malar  and  then  regulated  to  the  quiescent  state  by  the  controller.  Performance 
of  the  sliding  bank  es timator/ocntroller  is  compared  to  a  benchmark  of  a  single 
Kalman  filter/LQ  controller  that  has  (artificial)  knowledge  of  the  true  para¬ 
meter  values.  Comparisons  axe  based  vpcn  .Monte  Carlo  analysis  results. 

The  results  demonstrate  that  the  sliding  bank  multiple  model  adaptive 
estimator/controller  is  a  possible  alternative  to  the  conventional  full  bank 
multiple  model  adaptive  estimator/aontroller.  For  the  system  modeled  in  this 
study,  performance  of  the  sliding  bank  estimator/cgntroller  is  essentially 
identical  to  that  of  the  benchmark  after  a  short  parameter  acquisition  period. 
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